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ABSTRACT 


The  problem  of  target  detection  and  signal  parameter  estimation  in  a 
background  of  unknown  interference  is  studied,  using  a  multidimen¬ 
sional  generalization  of  the  signal  models  usually  employed  for  radar, 
sonar,  and  similar  applications  The  required  techniques  of  multivariate 
statistical  ar.olysis  are  developed  and  extensively  used  throughout  the 
stud} .  and  the  necessary  mathematical  background  is  provided  in 
Appendices.  Target  detection  performance  is  shown  to  be  governed  by  a 
form  of  the  Wilks’  Lambda  statistic,  and  a  new  method  for  its  numeri¬ 
cal  evaluation  is  given  which  applies  to  the  probability  of  false  alarm  of 
the  detector.  Signal  parameter  estimation  is  shown  to  be  directly  related 
to  known  techniques  of  adaptive  nulling,  and  several  new  results  rele¬ 
vant  to  adaptive  nulling  performance  are  obtained. 
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1.  INTRODUCTION  AND  PROBLEM  FORMULATION 


The  basic  physical  model  which  motivates  this  study  corresponds  to  an  array  of 
sensors  of  some  kind,  positioned  in  an  arbitrary  way  in  space,  and  providing  inputs  to 
a  processor  whose  nature  is  the  subject  of  the  analysis.  One  "sample”  is  a  set  of  out¬ 
puts  from  this  array,  arranged  as  a  vector.  These  samples  may  come  directly  from 
the  elements  of  the  array,  or  they  may  be  the  outputs  from  a  beamforming  network 
of  some  kind.  We  use  complex  variables  to  represent  the  data  since  we  are  concerned 
with  signals  which  modulate  a  carrier.  Then  the  real  and  imaginary  parts  of  a  com¬ 
plex  quantity  represent  the  in-phase  and  quadrature  components  of  such  a  signal. 
The  modifications  required  to  deal  with  real  data  are  generally  straightforward. 

The  basic  data  set  upon  which  a  processor  will  operate  is  a  collection  of  sample 
vectors,  arranged  as  the  columns  of  a  rectangular  data  array.  We  do  not  wish  to 
specify  the  physical  arrangements  in  greater  detail  because  the  mathematical  model 
itself  is  applicable  to  many  diverse  systems  which  may  use  adaptive  processing  of 
array  outputs  in  the  radar,  optical,  and  acoustical  fields,  and  so  on  Indeed,  the  ele¬ 
ments  of  the  sample  vectors  could  easily  have  a  significance  other  than  the  direct 
outputs  of  some  set  of  sensors.  However,  we  wish  to  draw  attention  to  certain  beisic 
assumptions  made  in  our  model  which,  in  certain  cases,  will  limit  its  relevance 

We  model  the  data  array  as  a  set  of  Gaussian  random  variables,  and  the  covari¬ 
ance  structure  of  the  model  is  used  to  characterize  the  "noise"  component  of  the 
data,  including  both  system  noise  and  any  random  external  interference.  On  the  other 
hand,  "signals”  are  considered  to  be  more  structured  contributions  to  the  input,  and 
these  are  modeled  by  making  appropriate  assumptions  about  the  mean  values  of  the 
elements  of  the  data  array.  The  emphasis  here  is  on  the  detection  of  these  signals 
and  the  estimation  of  their  parameters,  and  the  most  natural  applications  are  to 
radar  or  active  sonar,  where  coherent  processing  is  possible  due  to  the  known  form  of 
the  signals.  In  this  study,  a  general  linear  model  is  used  to  represent  signals. 

Our  strongest  assumption  concerning  the  covariance  structure  is  a  postulate  of 
stationarity;  the  sample  vectors  are  assumed  to  be  statistically  independent  and  to 
share  a  common  covariance  nr.atrix.  If  the  samples  correspond  to  successive  times, 
then  this  is  stationarity  in  the  usual  sense.  However,  the  concept  can  be  applied  in 
other  ways.  Fbr  example,  in  the  ladar  case  the  samples  may  correspond  to  successive 
range  bins;  but  the  data  may  already  have  been  subjected  to  some  form  of  processing 
embracing  a  larger  interval  of  time,  such  as  Fburier  transformation  (Doppler  process¬ 
ing)  of  the  array  outputs  before  the  adaptive  phase  of  the  process  in  which  we  are 
interested. 
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Another  strong  assumption  is  that  the  covariance  matrix  of  the  sample  vectors 
is  completely  unknown.  The  advantage  of  this  assumption  is  that  it  makes  the  math¬ 
ematics  more  tractable,  and  also  leads  to  a  decision  rule  for  which  the  probability  of 
false  alarm  is  independent  of  the  actual  covariance  structure  of  the  interference.  This 
is  a  highly  desirable  feature,  much  stronger  than  the  usual  constant-false-alarm-rate 
(CFAR)  property  in  which  the  false  alarm  rate  is  independent  of  the  level  of  the  noise. 
The  disadvantage  of  our  model  in  this  respect  is  that  it  includes  no  constraint  on  the 
structure  of  the  covariance  matrix,  other  than  the  obvious  one  of  positivity.  This 
generality  results  in  a  restriction  on  the  signal  parametrization  to  assure  a  meaning¬ 
ful  decision  rule,  a  point  discussed  more  fully  in  Appendix  5.  We  now  proceed  to  a 
detailed  description  of  the  model. 

Let  Z  be  a  complex  N  x  L  data  array  whose  elements  are  modeled  as  circular 
complex  Gaussian  random  variables  The  columns  of  Z  (i.e..  the  sample  vectors)  are 
assumed  to  be  independent  and  to  share  the  covariance  matrix  T.  This  is  expressed 
by  the  formula 

Cov(Z)=I®Il.  (1-1) 

where  ©stands  for  the  Kronecker  product,  and  is  the  LxL  identity  matrix.  This 
notation  is  defined  in  Appendix  1.  where  several  basic  properties  of  random  arrays 
needed  in  this  analysis  are  derived  The  more  general  problem,  in  which  the  matrix  1^, 
is  replaced  by  a  given  positive  definite  matrix  in  Equation  (1-1),  is  easily  transformed 
into  the  model  used  here  by  post-multiplication  of  the  data  array  by  a  suitable 
"whitening"  matrix. 

The  mean  of  Z  is  assumed  to  have  the  form 

EZ  =  aBr  ,  (1-2) 

where  a  (NxJ)  is  a  given  array,  B  (JxM)  is  an  array  of  signal  amplitude  parameters, 
and  T  (M  X  L)  is  also  a  given  array.  The  fixed  arrays  a  and  t  describe  the  assumed  sig¬ 
nal  structure,  as  will  be  illustrated  by  examples.  It  is  further  postulated  that  the 
rank  of  a  is  J^N,  while  that  of  t  is  M^L.  The  mathematical  setting  we  have  just 
described  is  a  generalization  to  complex  random  variables  of  a  formulation  often  used 
in  multivariate  statistics  to  model  quite  different  kinds  of  problems. 

The  basic  task  is  to  decide  between  two  hypotheses  concerning  this  statistical 
model:  Hq.  in  which  B  =  0  and  E  is  unknown;  and  H^.  in  which  both  B  and  E  are 
unknown.  An  unkno'wn  B  matrix  is  completely  arbitrary,  but  the  covariance  matrix 
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must  be  positive  definite,  a  property  we  denote  by  E  >  0.  The  decision  will  be  based  on 
the  Generalized  Likelihood  Ratio  (GLR)  principle.^  and  a  GLR  test  is  derived  below.  An 
estimate  of  the  signal  parameter  array  B  is  also  of  considerable  interest,  and  the 
Maximum  Likelihood  (ML)  estimator  of  B  is  automatically  obtained  in  the  derivation 
of  the  test  statistic. 

As  noted  earlier,  the  GLR  test  has  the  CFAR  property  in  that  its  probability  of 
false  alarm  (PFA)  is  completely  independent  of  the  actual  covariance  matrix  of  the 
data.  Under  the  null  hypothesis,  the  GLR  test  turns  out  to  be  a  complex  version  of 
Wilks’  A-statistic,  which  is  well  known  in  the  literature  of  multivariate  statistical 
analysis.  The  PFA  for  this  test  will  be  evaluated  by  a  technique  of  numerical  integra¬ 
tion  in  the  complex  plane.  Complete  results  for  the  probability  of  detection  (PD)  are 
obtained  only  in  special  cases,  but  certain  general  properties  of  the  PD  will  be  estab¬ 
lished  in  Section  6. 

The  signal  model  introduced  above  allows  considerable  flexibility.  The  simplest 
case  corresponds  to  J  =  1  and  M  =  1.  in  which  the  signal  array  is  represented  as  a  single 
dyadic  product.  The  rt  array  becomes  a  column  vector  of  N  elements,  and  t  is  then  a 
row  vector  of  L  elements.  A  specific  example  of  this  case,  in  which  a  is  a  general  vec¬ 
tor  and 


T  =  (1,0 . 0]  . 

is  discussed  in  References  3,  4,  and  5.  In  this  specialization,  o  may  represent  a  steering 
vector,  as  that  concept  is  usually  applied  for  adaptive  arrays,  and  the  model  allows 
signal  contributions  in  only  one  sample  vector.  In  this  special  case,  it  is  often  conven¬ 
ient  to  normalize  the  a  and  t  vectors  to  unity,  which  amounts  to  a  simple  redefini¬ 
tion  of  the  parameter  B. 

A  dual  version,  featuring  a  general  t  vector  and  a  a  vector  of  the  form 
a  ^  [1.0.  ...of  , 

is  treated  in  Reference  6,  on  the  basis  of  a  totally  different  physical  model.  Although 
these  special  cases  are  really  different  versions  of  the  same  problem,  and  can  be 
transformed  into  one  another  by  a  coordinate  change  of  the  kind  discussed  below, 
their  analyses  take  rather  different  forms  when  they  are  carried  out  in  the  original 
coordinates. 
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In  the  general  model,  the  a  array  controls  the  distribution  of  signal  contributions 
among  the  rows  of  the  data  array,  while  r  controls  their  appearance  among  the  col¬ 
umns.  If  the  components  of  the  sample  vectors  represent  the  outputs  from  the  sen¬ 
sors  of  an  array,  then  o  will  relate  to  the  spatial  character  of  the  signals.  Similariy.  if 
the  sample  vectors  themselves  correspond  to  successive  instants  of  time  (snapshots), 
then  T  will  describe  the  temporal  aspects  of  the  signals. 

Two  other  cases,  which  are  natural  duals  of  one  another,  are  direct  generaliza¬ 
tions  of  the  examples  given  above.  In  the  first,  a  is  an  arbitrary  fixed  array  which 
satisfies  the  rank  constrain*  mentioned  earlier  and  t  is  taken  to  be 

^  =  [  Im  0  ]  •  (1-3) 

where  Ij^  is  the  MxM  identity,  and  the  zero  array  here  is  Mx(L-M)  in  dimension. 
With  this  model  signals  appear  in  the  first  M  columns  only,  and  each  of  these  is  rep¬ 
resented  as  a  different  linear  combination  of  the  columns  of  a.  These  latter  columns 
determine  a  J-dimensional  subspace  of  the  N-dimensional  complex  vector  space  ®  . 
This  represents  a  generalization  of  the  ordinary  notion  of  an  array  steering  vector.  An 
example  of  such  a  model  for  signals  is  provided  by  multipath,  which  commonly 
occurs  in  seismic,  acoustic,  and  “over  the  horizon  ’  radar  applications.  For  our  model 
to  be  to  be  directly  applicable,  however,  the  multipath  characteristics  associated  with 
a  given  principal  signal  component  must  be  predictable,  except  for  a  set  of  complex 
amplitude  factors.  Another  example  is  one  in  which  the  signal  spatial  structure  is 
totally  unknown,  which  corresponds  to  the  special  case  J  =  N, 

In  the  dual  version,  <7  is  taken  to  have  the  form 


and  T  is  arbitrary  (but  full-rank),  so  that  signals  are  described  as  row  vectors,  con¬ 
fined  to  the  first  J  rows  of  Z  These  row  signals  are  independent  linear  combinations 
of  the  rows  of  t  which  determine  an  M-dimensional  subspace  of  the  L-dimensional 
complex  vector  space  The  characteristic  feature  of  the  general  problem  is  the 
restriction  of  signals  to  subspaces  in  both  the  row  and  column  directions,  and  the  key 
to  its  analysis  is  the  use  of  mathematical  techniques  which  are  adapted  to  this  geo¬ 
metrical  structure. 
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By  changing  coordinates,  the  general  problem  can  be  put  in  a  "canonical  form," 
which  provides  further  insight  into  the  postulated  signal  structure.  We  note  first  that 
the  data  array  Z  can  be  simultaneously  pre-  and  post-multiplied  by  unitary  matrices 
without  changing  the  form  of  the  problem.  We  write 

Zj-W^ZW^.  (1-5) 

where  Wj^  and  W^  are  unitary  matrices  whose  dimensions  are  indicated  by  their  sub¬ 
scripts.  The  new  array  is  characteri2ed  by  the  properties 

Cov(Zi)  =  W^ZwJsIl  (1-6) 

[see  Appendix  1,  Equation  (Al-44)]  and 

EZj  =  Wj^ctBtWl  (1-7) 

Since  the  matrix  E  is  unknown  and  the  unitary  transformations  are  reversible,  the 
new  matrix 


E,  = 

can  be  taken  as  the  unknown  covariance  matrix  of  the  columns  of  the  new  data 
array  Zj,  instead  of  E;  hence,  the  only  real  effect  of  this  change  of  coordinates  is  on 
the  signal  components,  as  expressed  by  the  mean  of  Zj, 

Now  we  introduce  the  singular  value  decompositions  of  a  and  t; 


T  =  Yj  ( D.^  0  !  Yg  . 

where  D„  and  D_  are  diagonal  matrices  of  dimension  JxJ  and  M  x  M,  respectively,  and 
^  '  H  H 

the  arrays  Xj,  Xg,  Y,.  and  Yg  are  unitary.  If  we  choose  Wj^  =Xj,  W^  =Yg.  and  then  set 

B,  =  D„XgBY,D,  , 

we  obtain  the  desired  canonical  form  for  the  signal  matrix; 


5 


EZj  = 


0 


Bi  I  Im  0  ]  = 


0 

0  0 


(1-8) 


The  new  signal  parameters  now  appear  only  in  the  upper  left-hand  corner  of  the  data 
array,  uniting  the  dual  forms  of  the  problem  into  one.  In  this  formulation,  the  logic 
of  our  restrictions  on  the  ranks  of  the  original  a  and  r  arrays  can  be  seen,  since  rank 
deficiencies  in  these  arrays  would  lead  to  zero  singular  values  in  or  D.^.  As  a  con¬ 
sequence,  some  of  the  signal  parameters  in  the  original  B  array  would  be  redundant. 
The  canonical  form  of  the  problem  will  not  be  used  as  a  basis  for  analysis.  It  seems 
preferable  to  derive  the  decision  rule  in  the  original  coordinates,  since  they  will  retain 
some  physical  meaning  from  the  initial  formulation  of  the  problem.  The  canonical 
form  then  appears  as  a  special  case.  In  some  situations,  of  course,  a  change  of  coordi¬ 
nates  may  be  quite  useful,  and  examples  of  this  will  be  provided  in  Section  2. 

We  mentioned  above  that  a  certain  limitation  must  be  applied  to  the  signal 
model  in  order  to  derive  a  GLR  test.  This  takes  the  form  of  an  inequality  relating 
three  of  the  dimensional  parameters  of  the  problerri,  namely: 

L  >  M  +  N  .  (1-9) 

If  this  inequality  is  not  satisfied,  then  the  GLR  procedure  does  not  lead  to  a  meaning¬ 
ful  test  statistic.  In  effect,  there  are  too  many  free  parameters  in  the  model,  and  the 
likelihood  function  under  the  Hj  hypothesis  can  be  made  infinite.  The  point  at  which 
this  occurs  will  be  noted  in  passing,  where  the  sufficiency  of  our  condition  will  be  evi¬ 
dent.  A  proof  of  its  necessity  is  given  in  Appendix  5. 

In  the  decision  problem  formulated  above,  the  null  hypothesis  (Hq)  represents  the 
complete  absence  of  signal  components  in  the  data  array  Following  the  example  of 
multivariate  statistics,  a  more  general  null  hypothesis  can  be  introduced  in  which  a 
homogeneous  linear  constraint  on  the  signal  parameter  array  B  replaces  the  original 
Hq  This  constraint  takes  the  form 

aB7  =  0  ,  (1-10) 

where  a  and  y  are  fixed  arrays  of  dimension  rxj  and  M  x  t,  respectively.  The  more 
general  decision  problem  will  be  treated  in  Section  7,  where  the  physical  significance 
of  this  model  wil’  be  discussed  Here,  we  mention  only  that  it  represents  the  presence 
of  “nuisance  signals,"  in  addition  to  the  desired  signals  in  the  data.  These  nuisance 
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signals  may  be  present  under  either  hypothesis,  but  the  desired  signals  are  either 
present  or  totally  absent.  A  decision  rule  will  be  found  in  this  case  whose  PFA  retains 
the  CFAR  property  and  is  also  completely  insensitive  to  the  presence  or  absence  of 
these  nuisance  signals. 

We  have  seen  that  the  a  array  determines  a  J-dimensional  subspace  of  (11^  which 
contains  e.ll  permissible  signal  vectors.  If  is  decomposed  into  a  subspace  A  and  its 
orthogonal  complement,  where  A  contains  this  J*dimensional  "signal  subspace,"  then 
the  covariance  matrix  L  will  automatically  be  partitioned  into  four  components.  Par¬ 
titionings  ot  this  kind  play  a  prominent  role  in  our  analysis.  Suppo.se  it  is  now 
assumed  that  the  off-diagonal  blocks  of  the  partitioned  covariance  matrix  vanish, 
thus  adding  some  structure  to  the  original  interference  model.  This  means  that  the 
interference  in  the  subspace  A  is  independent  of  that  in  its  orthogonal  complement, 
while  the  d’dgonal  blocks  of  the  covariance  matrix  are  still  considered  to  be  unknown. 
In  this  model,  the  components  of  the  data  vectors  which  lie  outside  the  subspace  A 
play  no  role  in  signal  detection  or  signal  parameter  estimation,  and  a  GLR  test  for 
this  problem  disregards  them  completely.  It  is  usually  advantageous  to  reduce  the 
dimensionality  of  the  data  model,  if  possible,  and  this  kind  of  supplementary  knowl¬ 
edge  of  the  covariance  structure  will  facilitate  such  a  reduction.  This  is  one  way  in 
which  our  model  can  be  extended  to  allow  some  structure  in  the  covariance  of  the 
interference 

The  model  can  be  generalized  in  other  ways  as  well.  For  example,  the  arrays  a 
end  T  may  contain  ‘'internal"  parameters  which  are  also  free  under  the  Hj  hypothe¬ 
sis.  To  deal  with  these,  we  first  obtain  the  GLR  test  statistic  f*5r  fixed  a  and  t,  and 
then  proceed  to  maximize  it  over  the  internal  parameters.  If  an  internal  parameter 
takes  on  only  discrete  values,  then  es'  ‘mation  of  this  parameter  is  equivalent  to  car- 
ryirig  out  a  multipie-hypothesis  test  Some  examples  of  these  generalizations  will  be 
mentioned  briefly  later,  but  discussion  of  them  will  be  limited  to  the  character  of  the 
GLR  lest  itself. 

The  special  case  J  =  N,  with  o  =  and  a  =  Ijj.  represents  a  complex  version  of  the 
classical  multivariate  linear  regression  problem,  which  is  thoroughly  treated  in  sev¬ 
eral  textbooks  (The  same  uame  is  often  given  to  the  special  case  in  which  7  =  1^  ) 
In  the  literature,  the  regression  problem  is  frequently  discussed  in  terms  of  a  data 
array  which  is  the  transpose  of  ours,  so  that  its  rows  arc  independent  instead  of  its 
columns.  The  analog  of  ou;  general  problem  in  terms  of  real  variables  also  appears  in 
the  statistical  literature**  '^  under  other  names,  such  as  the  generalized  multivariate 
analysis  of  variance  (GMANOVA).  In  statistics,  the  interest  is  usually  centered  on  the 
null  hypothesis,  which  corresponds  to  the  PFA  in  cur  context  The  detection  problem, 
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described  in  terms  of  complex  variables,  has  recently  been  studied  by  Khatri  and 

13  14 

Rao.  The  explicit  results  we  have  obtained  concerning  detection  probability  and 
the  statistical  character  of  the  signal  parameter  estimates  are  specific  to  the  class  of 
problems  wc  are  modeling  here,  and  many  of  these  are  new. 

Our  study  is  organized  as  follows.  In  Section  2,  the  GLR  test  itself  is  obtained,  and 
the  test  statistic  is  expressed  in  several  different  forms.  The  basic  statistical  character 
of  the  test  statistic  is  derived  in  Section  3,  and  the  probability  of  false  alarm  is  dis¬ 
cussed  in  Section  4.  In  Section  5,  the  probability  density  function  of  the  estimator  of 
the  signal  amplitude  parameter  array  is  treated,  and  the  probability  of  detection  of 
the  GLR  test  is  discussed  in  Section  6.  In  these  two  sections,  complete  results  are 
obtained  only  in  the  special  cases  J=l,  any  M,  and  M=l,  any  J.  Certain  properties  of 
the  solution  of  the  general  problem  are  also  obtained.  In  Section  7.  the  generalization 
mentioned  above  is  analysed,  with  the  result  that  this  problem  is  reduced  to  the 
original  one  by  means  of  straightforward  transformations  which  eliminate  the 
redundant  data. 

The  Appendices  are  of  two  kinds:  the  first  three  contain  mathematical  results  of 
a  background  nature,  all  used  freely  in  the  main  portion  of  the  text.  The  other 
Appendices  contain  special  topics,  separated  out  for  readability.  In  Appendix  1.  a  col¬ 
lection  of  known  resultf  concerning  matrices  and  random  arrays  is  assembled. 
Perusal  of  this  Appendix  is  recommended,  since  it  contains  a  number  of  identities  and 
lemmas  indispensable  to  an  understanding  of  the  analysis  Appendix  2  is  a  collection 
of  formulas  for  di-jtributions  related  to  the  Gaussian  in  complex  form.  The  corre¬ 
sponding  real  distributions  are  well  known;  some  of  the  formulas  derived  here  are 
less  frequently  seen.  More  background  material  is  included  in  Appendix  3.  The  latter 
results  relate  mainly  to  integral  proper  vies  of  multivariate  complex  distributions,  and 
they  are  less  essential  to  the  main  development  than  are  those  of  Appendix  1. 

In  Appendix  4,  an  alternate  derivation  of  the  GLR  test  is  presented.  The  resulting 
test  statistic  is  of  a  different  form  than  those  obtained  in  Section  2,  but  it  is  shown 
in  this  Appendix  that  it  is  statistically  completely  equivalent  to  the  others.  In  Appen¬ 
dix  5,  a  proof  of  the  necessity  of  the  condition  expressed  in  Equation  (1-9)  is  provided. 
The  probability  of  false  alarm  for  the  GLR  lest  is  evaluated  explicitly  in  Section  4 
only  for  certain  special  cases  In  Appendix  6,  a  procedure  is  described  by  which 
numerical  evaluation  of  this  probability  for  arbitrary  values  of  the  parameters  can 
be  carried  out.  Finally,  in  Appendix  7,  computational  algorithms  applicable  to  the  GLR 
test  in  either  of  two  forms  are  presented. 
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3.  THE  GENERALIZED  LIKELIHOOD  RATIO  (GLR)  TEST 


This  section  contains  a  derivation  of  the  GLR  test  for  the  original  problem 
described  in  Section  1,  in  which  the  null  hypothesis  corresponds  to  a  mean  of  zero  for 
the  data  array.  Background  material  on  the  complex  multivariate  Gaussian  probabil¬ 
ity  density  function  wi'l  be  found  in  Appendix  1. 

Under  the  null  hypothesis,  the  joint  probability  density  function  (pdf)  of  the  ele¬ 
ments  of  the  data  array  is  given  by 


1  ^-Tr(E'‘Z2”) 


NL|.p|L 
7T  |Z.| 


(2-1) 


where  Tr  stands  for  trace,  the  superscript  H  represents  Hermitian  transpose,  and  the 
bars  surrounding  E  denote  its  determinant.  According  to  the  model  described  in  Sec¬ 
tion  1,  the  pdf  under  hypothesis  Hj  is 


fi(Z;E.B) 


g  -Tr(E*‘{2  -oBtXZ  -cBt)”) 


(2-2) 


Each  of  these  density  functions  must  be  maximized  over  the  unknown  covariance 
matrix  2,  and,  for  the  Hg  hypothesis,  we  obtain  the  ML  estimator^^ 

Eg  =  J;  ZZ”  (2“3) 

u 

The  square  array  ZZ  is  subject  to  the  complex  Wishart  distribution,  with  dimension 
N  and  L  “complex"  degrees  of  freedom.  A  discussion  of  complex  Wishart  matrices  and 
some  of  their  properties  is  gi>^en  in  Appendix  1.  A  derhation  of  the  complex  Wishart 
distribution  itself  will  be  found  in  Appendix  3.  By  the  as.'umption  expressed  in  Equa¬ 
tion  (1-9),  we  are  assured  that  this  matrix  is  positive  definite  w^th  probability  one. 
Substituting  in  Equation  (2-1).  we  obtain 

fgCZ-.Eg)  =  [(e7T)^’;2oi]'V  (2-4) 


The  analogous  ML  estimator  of  E  under  Hj  is,  of  course. 
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(2-5) 


Ei(B)  =  i(Z-aBT)(Z-(7BT)”  . 

which  is  a  function  of  B.  The  final  estimator  of  the  covariance  matrix  under  the  Hj 
hypothesis  will  be  obtained  when  B  is  replaced  by  its  estimator,  which  must  still  be 
derived.  The  formula  analogous  to  Equation  (2-4)  is,  of  course, 

fi[Z,E,(B),B]  =  [(e7T)^|Si(B)|]'^  .  (2-6) 


The  GLR  test  statistic  is,  by  definition. 

Max  fi(Z;E,B)  Max  fi[Z;Ej(B),B] 

E.B _ _  _B _ 

Max  fo(Z;E)  fo(Z;Eo) 

£ 

A  test  using  this  statistic  is  evidently  equivalent  to  a  test  based  on 


MinlEjl 

B 


(2-7) 


which  is  the  L'’'^  root  of  the  GLR  statistic,  after  substitution  from  Equations  (2-4)  and 
(2-6).  Combining  results,  we  obtain 


_ [ZZ|^| _ 

Min  l(Z-aBT)(Z-aBT)”|  ' 
B 


(2-8) 


and  Hj  is  accepted  if  f  >  Iq. 

We  now  introduce  some  tools  which  will  allow  us  to  manipulate  the  various 
arrays  in  a  manner  directly  related  to  certain  subspace  projections  associated  with 
the  given  signal  arrays,  a  and  t.  Beginning  with  t,  we  note  that  the  M  x  M  array 
is  positive  definite,  since  t  itself  has  rank  M.  Therefore,  we  can  introduce  a  square-root 
array 


(t  t 


H^I/2 


>  0  . 
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the  notation  indicating  that  a  positive-definite  square  root  has  been  chosen.  Square 
roots  of  positive-definite  matrices  are  used  frequently  in  the  ensuing  work.  An  equiv¬ 
alent  procedure  would  be  to  represent  such  matrices  in  terms  of  Cholesky  factors.  It 
should  be  emphasized  that  these  factorizations  always  occur  in  intermediate  stages  of 
the  analysis,  and  that  none  of  the  results  will  depend  on  which  choice  which  has  been 
made. 

Using  the  above  definition,  we  introduce  the  array 

P=(tt“)-‘^t  (2-9) 

If  M  =  1,  p  reduces  to  a  unit  vector  in  the  direction  of  the  row  vector  t.  In  general,  the 
following  properties  follow  directly  from  the  definition: 

(TT»)'^p.  (2-10) 

The  first  of  these  equations  shows  that  the  rows  of  p  are  orthonormel,  and  the  right 
side  of  the  second  equation  (which  is  idempotent  and  Hermitian)  is  a  standard  form 
for  a  projection  matrix*®  onto  the  subspace  of  which  is  spanned  by  the  rows  of  t. 
This  is  the  M-dimensional  row  space  of  t.  and  the  rows  of  p  form  a  basis  in  it.  The 
last  equation  is  the  analog  of  the  representation  of  a  vector  as  the  product  of  its 
norm  and  an  appropriate  unit  vector.  When  M=  L.  t  is  invertible,  p  is  unitary,  and  the 
last  of  Equations  (2-10)  is  a  polar  decomposition  of  t.  It  is  characteristic  of  our 
approach  that  basis  arrays  for  subspaces  are  used  directly,  rather  than  the  projection 
operators  themselves,  to  carry  out  the  analysis. 

The  subspace  of  which  is  orthogonal  to  the  space  spanned  by  p  is  of  dimension 
L-M,  and  we  can  introduce  an  orthonormal  set  of  L-M  row  vectors  to  serve  as  a 
basis  for  it  in  many  ways  Let  q  be  an  (L-M)xL  array  whose  rows  form  such  a  basis. 
The  relations 

qp**  =  0  (2-11) 


pp”  = 


pHp  = 


T  = 
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express  these  properties,  and  p  and  q  together  will  form  a  unitary  matrix  of  dimen¬ 
sion  L  X  L 


=  Ul  (2-12) 

The  unitary  property  of  contains  the  orthonormality  rules  already  given,  and  also 
the  relation 

p”p  +  q”q  =  1l  .  (2-13) 

which  expresses  the  fact  that  the  rows  of  p  and  q  together  span 

If  we  multiply  Z  by  1l  on  the  right  and  make  use  of  Equation  (2-13).  we  obtain 
the  decomposition 


P 

q 


Z  =  Zp  p  +  Zq  q 


where  the  "components"  of  Z  are  defined  by  the  equations 


(2-14) 


Zp  s  Z  p” 

Zq  =  Zq“  .  (2-15) 

Note  that  Zp  has  dimension  NxM,  while  Zq  is  an  Nx(L-M)  array.  This  decomposition 
may  be  introduced  in  an  equivalent  way  by  writing 

zuf-  zlp%"|  =  lZpZ,|  .  (2-16) 

which  shows  that  the  components  of  Z  are  formed  by  first  rotating  the  coordinates 
in  (by  means  of  the  unitary  transformation)  and  then  partitioning  it  into  two 
subspaces. 

The  complex  vector  space  is  also  decomposed,  based  on  the  structure  of  the  a 
array.  Since  a  has  rank  J,  we  can  introduce  the  positive-definite  square-root  matrix 


(a”a)'^  >  0 
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and  the  corresponding  array 


esaCa^a)'*^.  (2-17) 

The  properties 

e«e  =  Ij 

ee”  =  a(a“a)-‘a» 

a  =  e(a”a)'^  (2-18) 

then  follow  directly  from  the  definitions.  The  e  array  forms  a  basis  for  the 
J-dimensional  subspace  of  spanned  by  the  columns  of  a  (the  column  space  of  o). 
The  second  of  Equations  (2-18)  contains  a  projection  matrix  which  projects  onto  this 
column  space. 

Next,  we  introduce  a  basis  in  the  (N  -  J)-dimensional  subspace  orthogonal  to  the 
span  of  e.  These  new  vectors  will  form  the  columns  of  an  array  of  dimension 
Nx(N  -  J)  which  will  be  called  f,  and  which  satisfies  the  orthonormality  relations 

=  1n-j 

f”e  =  0  .  (2-19) 

The  unit  arrays  e  and  f  together  form  another  unitary  matrix,  this  time  of  dimen¬ 
sion  N  X  N,  as  follows 

I  e  f  1  =  Uf,  .  (2-20) 

and  the  analog  of  Equation  (2-13)  is  then 

ee”  +  ff”  =  lf<  (2-21) 

Using  this  apparatus,  we  can  express  the  signal  model  in  terms  of  e  and  p.  writ¬ 
ing 


EZ  =  oBt  =  ebp  . 


(2-22) 
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where  b  is  defined  by 


b  s  (ff“(7)'^B(TT“)'^  .  (2-23) 

We  now  work  with  b  as  the  array  of  unknown  signal  amplitude  parameters,  returning 
to  B  only  at  the  end  of  the  derivation.  In  terms  of  the  new  quantities.  Equation  (2-5) 
can  be  written 


£,(b)  =  i(Z-ebp)(Z-ebp)”  . 
and  Equation  (2-8)  is  the  same  as 

^  ^  _ [ZZj^i _ 

Min  |(Z  -ebp)(Z  -ebp)^! 
b 

The  denominator  of  this  equation  is  now  written 
Min  |F(b)|  , 

b 

where  F(b)  is  given  by 

F(b)  s  (Z-ebp)(Z  -ebp)” 

-  ebb  e  -  ebZp  -  Zpb  e  +  ZZ  . 


(2-24) 


(2-25) 


(2-26) 


In  the  second  line  we  have  used  the  new  definitions  and  also  the  first  of  Equa¬ 
tions  (2-10).  It  follows  directly  from  Equation  (2-14)  that 

ZZ“  =  ZpZ”  +  Z^ZJ  .  (2-27) 

and,  therefore,  we  can  write 

F(b)  =  (eb  -  Zp)(eb  -  Zp)"  +  S  .  (2-28) 

in  which  we  have  introduced  t  he  new  quantity 
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(2-29) 


Like  ZZ^.  the  S  array  is  subject  to  a  complex  Wishart  distribution  of  dimension  N,  but 
this  time  with  L  -  M  complex  degrees  of  freedom,  in  accordance  with  the  dimensional¬ 
ity  of  Zq.  S  is  positive  definite  (with  probability  one)  as  a  consequence  of  Equa¬ 
tion  (1-9),  and  is  therefore  an  invertible  matrix. 

Returning  to  the  minimization  problem,  we  note  the  following  fact: 

Min  |Aj  +  u^^Agul  ■  lAj|  ,  (2-30) 

u 

which  is  valid  when  Aj  and  Ag  are  positive-definite  matrices  (not  necessarily  of  the 
same  dimension)  and  u  (in  general  rectangular)  is  an  arbitrary  array.  To  prove  this 
result,  we  introduce  positive-definite  square  roots  of  Aj  and  Ag  and  define 

w  =  A^  u  Aj*^  . 


Then 


[A]  f  Ag  ui  =  lAjI  il  T  w^  w'l  . 

and  the  minimization  can  be  carried  out  over  w  instead  of  u.  But 

Min  |I  +  w^  wl  =  1  .  (2-31) 

W 

because  w^w,  being  positive  semidefinite.  has  non-negative  eigenvalues  It  follows  that 
the  determinant  in  Equation  (2-31)  is  a  product  of  eigenvalues,  all  of  which  are 
greater  than  or  equal  to  unity.  A  unique  minimum  is  therefore  achieved  for  w  =  0, 
which  corresponds  to  u  =  0  in  the  original  notation. 

In  order  to  apply  this  result,  we  make  use  of  an  elementary  determinant  identity 
(Equation  (Al-2)  of  Appendix  l]  to  write 

|F(b)|  =  |S||J(b)l  , 

where  J(b)  is  given  by 
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(2-32) 


J(b)  H  +  (eb-Zp)"s-‘(eb-Zp)  . 

It  is  clear  that  the  second  term  on  the  right  side  of  this  expression  for  J(b)  is  positive 
semi-definite,  hence  J(b)  itself  is  positive  definite  for  any  array  b.  Multiplying  out  the 
terms  of  Equation  (2-32).  we  obtain 

J(b)  =  1„  +  b”e”s‘‘eb  -  b“e”s‘‘Zp  -  z”s"*eb  +  z”s'^Zp  .  (2-33) 

Since  S  >  0  and  e  has  full  rank,  it  follows  that 

e^S'^e  >  0  . 

This  allows  us  to  define  the  array 

b  =  (e”s‘‘e)’U”s'^Zp  .  (2-34) 

and.  using  this  definition,  we  can  “complete  the  square”  with  respect  to  b  in  Equa¬ 
tion  (2-33)  The  result  is  the  formula 

J(b)  =  Im  +  ZpS'^Zp  -  b”(e“s'*e)b  +  (b-b)”(e” S'^e)(b-b)  . 

We  have  noted  that  J(b)  is  always  positive  definite;  hence,  in  particular, 

J(b)  >  0  . 

Thus,  we  can  apply  Equation  (2-30)  to  the  determinant  of  J(b).  since  the  conditions  for 
its  validity  are  satisfied.  The  result  is 

Min  iJ(b)|  =  Um  +  z”s''Zp  -  b”(e”s'’e)b|  .  (2-35) 

b 

The  ML  estimator  of  b  is  therefore  given  by  Equation  (2-34),  and  the  final  estima¬ 
tor  of  covariance  under  hypothesis  Hj  is  given  by 

Ij  =  i  [  S  +  (Zp  -  eb)(Zp  -  eb)”  ]  (2-36) 
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It  is  an  interesting  fact  that  this  estimator  can  be  substituted  for  S  in  Equa¬ 
tion  (2-34),  and  the  result  is  still  a  valid  representation  of  the  amplitude  parameter 
array  estimator.  Tb  see  this,  we  first  observe  that 

Zp-eb=  Zp-e(e”s-'e)-'  e^S'^p. 
from  which  it  follows  that 

e“s‘‘(Zp-eb)  *  0  .  (2-37) 

Next,  we  use  the  generalized  Woodbury  identity,  which  is  derived  as  Equation  (Al-5) 
in  Appendix  1.  to  write 

(LEj)-^  =  S'^-S‘^(Zp-eb)[lM  +  (Zp-eb)”s'‘(Zp-eb)]'\Zp-eb)”s‘‘  .  (2-38) 

Using  the  Hermitian  transpose  of  Equation  (2-37).  we  see  from  Equation  (2-38)  that 
(LEi)"'  e  =  S'^e  . 

When  this  equivalence  is  used  in  Equation  (2-34).  the  result  is 

b  =  (e“(Ei)'‘  e)'‘  e“(S,)‘‘  Zp  .  (2-39) 


which  is  the  desired  form 

Returning  to  the  derivation  of  the  test  statistic,  we  substitute  from  Equa¬ 
tion  (2-34)  to  obtain 

—  __  b^(e^S~*e)b  _  Z^  R Z 


where 


P  =  S"'  -  S'‘e(e“s‘'e)'’  e“s‘^  .  (2-40) 

Combining  these  results  and  substituting  in  Equation  (2-35),  we  obtain  the  desired 
minimization 
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(2-41) 


Min  |F(b)|  =  |S|  Min  |J(b)l  =  |S||I^j  +  z“PZp|  . 
b  b 


The  numerator  of  Equation  (2-25)  can  be  developed  in  the  form 


|ZZ”l  =  |ZpZ”  +  SI  =  ISIUm  +  z“s‘*Zpi . 
and  then,  finally,  the  GLR  test  statistic  is  obtained  as  a  ratio  of  determinants: 


Hm  +  ZpS'^Zpl 

Hm  +  zJPZpl 


(2-42) 


In  the  special  case  described  by  Equation  (1-3),  where  the  signal  contributions  are 
confined  to  the  first  M  columns  of  the  data  array,  the  decomposition  of  Z  into  the 
components  Zp  and  Z^  is  simply  a  separation  of  columns  into  two  groups,  and  for¬ 
mula  (2-42)  has  a  natural  interpretation  in  this  case.  In  Appendix  4  a  derivation  of 
the  GLR  test  is  carried  out,  by  a  variation  of  the  technique  used  here,  which  leads  to 
a  result  of  quite  different  form  than  Equation  (2-42),  although  completely  equivalent 
to  it.  This  other  form  is  naturally  suited  to  the  dual  special  case,  described  by  Equa¬ 
tion  (1-4),  in  which  signals  are  confined  to  the  first  J  rows  of  the  data  array. 

Working  back  through  the  definitions,  we  obtain  the  relations 
Zp  =  Zr"(TT“)-« 

S  »  Zq^qZ**  =  Z(Il  -  t]z“  (3-43) 


and 


P  =  -  S'‘a(a”s'*CT)''a”s''  .  (2-44) 

With  their  help,  the  test  statistic  can  be  expressed  directly  in  terms  of  quantities 
which  appear  in  the  original  formulation  of  the  problem.  In  particular,  none  of  the 
arrays  introduced  as  bases  in  the  various  subspaces  appears  in  the  final  result.  Fbr- 
mula  (2-42)  is  a  direct  generalization  of  the  GLR  test  obtained  for  the  special  case 
treated  in  References  3  and  4. 
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Tb  facilitate  comparison  with  these  previously  obtained  results,  the  GLR  test  can 
be  recast  in  a  different  form  If  we  make  the  definitions 


D  .  I„  +  Z«S-‘2p 

r*  —  C  ”  ^ 
0=^0  O 


A  —  C  *  ^  *7 

A  =  a  S 


(2-45) 


and  also  make  use  of  Equation  (2-44),  we  can  write  Equation  (2-42)  as 


I  = 


IDI 


ID  -  A^G'^Ai 


(2-46) 


Since  D  is  positive  definite,  we  can  multiply  both  numerator  and  denominator  by 
both  on  the  right  and  on  the  left,  and  thus  convert  the  test  statistic  to  the 

form 


I  =  - ^ -  . 

Hm  -  ^1 

where  t\  is  given  by 

If  M=  1,  77  is  a  scalar,  and  the  test  statistic  is  simply 


L  = 


1  -  77 


Moreover. 


V  = 


a”g'*  A 
D 


Zj;s'^(7(c7”s‘‘a)''  o-”s'‘Zp 

1  +  zJs'^Zp 


in  this  case. 


19 


On  the  other  hand,  if  J  =  1  (and  M  is  unrestricted),  then  G  is  a  scalar  and  we  can 
apply  identity  (Al*3)  of  Appendix  1  to  obtain 


I^M  “  ’ll  =  ^  ~  - 


where 


ad->a»  _  <^“s~4p(iM  -H  z;s-*Zp)-^  ZgS'V 


\~1  r»Hc“l 


77  S 


a  b  <7 


If  J  =  1  and  M=  1.  then  tj  and  77'  coincide  and  the  test  becomes 


(a”s''o)(l  ZSS-'ZJ 


^0-1 

in 


(2-47) 


which  is  the  form  obtained  in  Reference  3. 

For  general  values  of  J  and  M,  the  A  array  introduced  above  can  be  expressed  as 


A=£tS  Zp  =wZp  , 


where 


w  s  S  *0 

H 

Post-multiplication  of  the  data  array  by  p  corresponds  to  ordinary  coherent  inte¬ 
gration  of  the  elements  of  Z.  in  the  row  direction,  using  a  set  of  matched  filters 
determined  by  the  r  array.  Similarly,  pre-multiplication  by  w^  corresponds  to  adap¬ 
tive  whitening  and  coherent  integration  in  the  column  direction,  by  means  of  a 
"weight  array"  w.  formed  from  the  signal  "steering  array"  o  and  the  S  matrix. 
Except  for  a  constant  factor,  the  matrix  S  is  a  sample  covariance  matrix  based  on 
the  signal-free  vectors  which  comprise  the  array  Z^.  We  introduce  the  notation 

(L-M)‘SsEq  (2-48) 

for  this  estimator,  indicating  that  it  is  formed  from  the  Z^  component  alone. 
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The  ML  estimator  of  the  signal  amplitude  array  B  is  recovered  by  the  use  of 
Equations  (2-23),  (2*34).  and  (2-43)  The  result  is 

B=  (a^S'^c)*' a”  S‘^Zt”(tt“)‘^  .  (2-49) 

This  expression  represents  a  direct  generaliration  of  a  standard  algorithm  used  for 
adaptive  nulling.  Tb  illustrate  this  more  explicitly,  consider  the  case  in  which  the  t 
array  has  the  rimple  form  expressed  by  Equation  (1-3).  This  mode.,s  a  situation  in 
which  Zp  consists  of  the  first  M  columns  of  the  data  array,  representing  the  data 
vectors  which  may  contain  signals,  while  the  others  constitute  the  array.  We  can 
then  write  Elquation  (2-49)  in  the  form 

B=  (a«Eq^a)-^  ^"S^^Zp, 

which  expresses  the  columns  of  the  B  estimator  array  as  matrix  products  involving  a 
“weight  array"  and  the  columns  ci  Zp.  In  this  interpretation,  the  columns  of  the  B 
fstimator  array  represent  the  outputs  of  a  generalized  adaptive  nulling  processor 
whose  inputs  are  the  sample  vectors  which  form  the  columns  of  Zp.  If  J-1,  the 
weight  array  reduces  to  a  weight  vector,  and  the  correspondence  with  the  standard 
adaptive  nulling  technique,  based  on  sample  matrix  inversion,  is  complete.  In  Sec¬ 
tion  5,  the  joint  probability  density  of  the  elements  of  the  B  estimator  array  (which  is 
a  row  vector  in  this  case)  will  be  obtained,  and  '  he  relation  to  adaptive  nulling  will  be 
pursued  further. 

For  the  special  case:  J  -  N.  the  matrix  a  is  square  and,  by  hypothesis,  it  has  full 
rank.  FVom  Equations  (2-18)  we  see  that  the  array  e  is  unitary  under  this  assumption, 
and  our  for»nulas  will  simplify  accordingly.  In  particular,  the  matrix  P  will  vanish  in 
this  case,  leaving  only  the  numerator  in  Equation  (2-42)  for  the  GLR  test.  In  addition, 
the  estimator  of  the  amplitude  array,  given  by  Equation  (2-49),  will  assume  the  sim¬ 
ple  form 


S  -1-7  H/  Hn-I 
B  =  o  Zt  (tt  )  , 

when  J=N.  As  noted  in  Section  1,  the  complex  version  of  the  multivariate  linear 
regression  problem  (without  the  generalized  null  hypothesis)  is  characterized  by 
hence,  our  results  are  easily  speciali'',ed  to  this  problem. 
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In  an  extension  of  our  model,  of  the  type  mentioned  in  Section  1,  t  is  allowed  to 
contain  a  discrete  internal  parameter.  In  other  words,  r  is  actually  one  of  several 
given  T  arrays,  and  the  problem  is  to  decide  which  of  these  arrays  best  describes  the 
signal,  if  signal  is  actually  deemed  to  be  present.  One  can  evaluate  the  GLR  test  statis¬ 
tic  for  each  t.  and  if  the  largest  of  these  exceeds  a  threshold  for  signal  detection,  then 
use  it  to  decide  which  signal  was  received. 

A  simple  example,  in  which  M=l,  would  arise  if  the  sample  vectors  corresponded 
to  regular  instants  of  time  and  the  parametrized  t  arrays,  each  a  row  vector, 
described  different  possible  temporal  sequences,  such  as  those  corresponding  to  the 
Doppler  phase  variations  of  a  moving  radar  target.  One  could  test  for  one  value  of  the 
Doppler  parameter  at  a  time,  using  the  remaining  part  of  the  data  array,  described 
by  Z.,  for  noise  estimation  via  the  matrix  S.  As  noted  earlier,  the  GLR  test  involves 

''  *4  H 

post-multiplication  of  the  data  array  by  p  ,  and  p  is  just  a  normalized  version  of  the 
T  vector  in  this  case;  hence,  this  represents  coherent  integration  in  the  ordinary 
sense. 

The  formation  of  a  conventional  "Doppler  filter  bank."  based  on  L  time  samples, 
is  equivalent  to  post-multiplication  of  the  original  data  array  by  a  suitable  unitary 
matrix.  The  new  t  vectors  will  then  be  unit  vectors,  each  containing  a  single  compo¬ 
nent  equal  to  unity,  and  the  rest  all  zero.  Each  of  the  multiple  hypotheses  in  this 
case  amounts  to  placing  the  signal  in  a  different  column  of  Z.  This  is  an  example  of  a 
situation  in  which  a  change  of  coordinates,  mentioned  in  Section  1,  is  a  natural  thing 
to  do. 

Added  insight  into  the  significance  of  the  GLR  test  statistic  and  the  associated  ML 
signal  pa.*ameter  estimator  is  gained  by  considering  the  simpler  version  of  our  prob¬ 
lem  in  which  the  covariance  matrix  E  is  known.  The  hypotheses  concerning  the  signal 
components  remain  the  same.  From  Equations  (2-1)  and  (2-2),  together  with  Equa¬ 
tions  (2-22)  and  (2-26),  it  follows  that  the  logarithm  of  the  likelihood  ratio  for  this 
problem  is  given  by 

A(b)  =  -Tr}E-‘[F(b)-  F(0)]j 

=  -Tr(E-'(eb-Zp)(eb-Zp)"  -  E'^ZpZ”) 

=  -Tr[(eb-Zp)'^E  '(eb-Zp)  -  Z^E'^Zj.  (2-50) 

We  define 

bj;  H  (e”E'‘e)  “  e^E'^Zp  .  (2-51) 
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using  the  subscript  to  indicate  that  Z  is  known,  and  complete  the  square  in 
Equation  (2‘50).  The  result  is 

X(b)  =  -Tr[(b-bj;)”(e”5:'’e)(b-b£)  -  b^(e“5:'‘e)bj;]  . 
which  is  clearly  maximized  by  the  choice 
b  =  bj,  . 

thus  establishing  the  ML  estimator  of  b.  This  is.  of  course,  the  classical  solution, 
expressed  here  in  terms  of  the  component  Zp.  Fbrm.ula  (2-34)  is  a  direct 
generalization  of  this  result. 

For  the  non-adaplive  test  statistic  itself,  we  have 

X  =  Max  X(b)  =  Tr(b?(e“E‘^e)bj.]  .  (2-52) 

b 

or 

X  -  Tr[zjE'’c(c”E*‘a)'‘a”E'^Zp]  .  (2-53) 

These  formulas  will  be  developed  further  in  Sections  3  and  5,  and  the  relationship  to 
the  GLR  test  statistic  for  the  general  problem  will  be  elucidated. 

We  close  this  section  with  the  derivation  of  some  alternative  expressions  for  the 
GLR  test  statistic  which  exhibit  the  roles  of  the  subspace  projections  in  a  rather  nice 
way.  To  obtain  the  first  of  these  forms,  we  apply  identity  (Al-2)  of  Appendix  1, 

|G|1D  -  a”g'‘a!  =  IDIIG  -  AD'^a”|  .  (2-54) 

to  Equation  (2-46),  with  the  result 

<  =  - !=! _ , 

ic  -  ad’'a”i 

Eliminat  ing  the  new  definition.?,  we  have 
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_ |a“s~^a| _ 

(7“[s‘'  ~  s'^Zpd^  +  z”s“^Zp)'‘zJs'^](7 


(2-55) 


Applying  the  generalized  Woodbury  identity  [Equation  (Al-5)]  to  the  denominator  of 
Equation  (2-55),  we  obtain  the  desired  result: 


ItT^S'^al 


|e“s‘‘ei 


|a”(S  +  ZpZ")‘^a|  le”(S  +  ZpZ”)-‘e! 


(2-56) 


Equivalent  versions  of  this  test  statistic  are: 


|a"(Z,Z;)-a|  |o«(ZZ«-  Z,zS)-‘ai 


|a”(ZZ”)'‘a! 


|a”(ZZ”)‘‘CT| 


(2-57) 


Note  that  the  second  form  above  makes  use  of  a  sample  covariance  matrix  based  on 
the  full  data  array  Z, 

E^quation  (2-57)  is  a  generalization  of  a  formula  stated  by  Brillinger.'^  Fbr  the 
case  J=l.  in  which  cr  is  a  column  vector.  Equation  (2-57)  may  be  interpreted  as  the 
ratio  of  maximum-likelihood  (Capon)  spectral  estimates,*®  in  the  direction  of  a,  using 
either  all  the  data  in  the  Z  array  or  only  its  projection  onto  the  orthogonal  comple¬ 
ment  of  the  row  space  of  t. 

The  simple  form  which  the  GLR  test  assumes  when  J  =  N  is  easily  reproduced 
from  Equation  (2-56).  Since  a  is  then  square  and  non-singular,  its  determinant  may 
be  factored  out  of  the  numerator  and  the  denominator  of  this  ratio,  with  the  result 


IS  +  Zp7.p!  „  , 

-Isp  =  l'«  "  Zpl  ■ 


(2-58) 


Equation  (2-54)  has  been  applied  to  obtain  the  final  form,  which  is  the  same  as  that 
to  which  Equation  (2-42)  reduces  when  J  =  N.  If  t  .^-  eigenvalues  of  the  matrix  ZpS'*Zp 
are  called  Xj„,  then,  obviously, 


|I„  +  z"s-'Zp|=  0(1  +  ''™)' 


(2-59) 
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If  M  >  N.  some  of  these  eigenvalues  will  vanish  since  the  corresponding  matrix  will  not 
have  full  rank,  but  Equation  (2*59)  will  remain  valid. 

A  generalization  of  our  basic  problem  will  be  mentioned  briefly  here,  since  Equa¬ 
tion  (2-57)  is  especially  suitable  to  its  analysis  and  a  result  very  similar  to  Equa¬ 
tion  (2-59)  can  be  obtained.  In  this  model,  everything  is  the  same  as  already  postu¬ 
lated.  but  the  a  array  is  now  allowed  to  be  an  arbitrary  full-  rank  array  of  dimension 
NxJ.  In  the  original  model,  the  signals  are  drawn  from  the  given  J-dimensional  sub¬ 
space  of  which  is  determined  by  the  a  array.  In  the  generalization,  the  signals  are 
drawn  from  any  subspace  of  dimension  J.  The  structure  imposed  by  t,  which  controls 
the  distribution  of  signals  among  the  columns  of  the  data  array,  is  not  changed. 

A  likelihood-ratio  test  for  the  new  problem  is  evidently  obtained  by  maximizing 
the  statistic  expressed  by  Equation  (2-57)  over  the  a  array,  since  the  likelihood  ratio 
itself  is  directly  related  to  C.  Suppose  that  Aj  and  A2  are  positive-definite  matrices  of 
order  N.  Then,  it  can  be  shown  that 


Max 

a 


k^Ajoi 
\a^  k2a\ 


(2-60) 


where  the  maximization  is  carried  out  over  all  full-rank  NxJ  arrays  0,  and  the  /Zj 
are  the  eigenvalues  of  the  matrix  A|(A2)*\  ordered  from  largest  to  least; 


Ml  >  ^^2  >  •  >  Mn 

For  application  to  Equation  (2-57).  this  matrix  product  is 


(ZqZj)-‘  ZZ‘'  =  S''(S  +  ZpZ»)  =  1^  +  S''ZpZ» 

But  the  matrices  S'^ZpZp  and  ZpS'^Zp  share  the  same  non-zero  eigenvalues  and.  con¬ 
sequently,  the  product  of  the  eigi.  alues  of  Ij^  +  S’^ZpZp  is  the  same  as  the  product  of 
the  eigenvalues  of  Ij^  +  ZpS  'Zp.  A  proof  of  this  result,  and  also  of  Equation  (2-60).  will 
be  found  in  Appendix  1.  The  GLR  test  statistic  for  the  generalized  problem  therefore 
takes  the  form 


Max 

o 


|a”(ZqZ;,‘)~^g| 

|0“(ZZ”)''(Ti 


(2-61) 
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If  J  ^  M  in  the  generalized  model,  the  test  cr  \  'cides  with  that  obtained  for  the 
special  case  of  the  original  problem  in  which  !  understand  this  feature,  it  is 
useful  to  imagine  the  special  form  of  the  t  a  bed  by  formula  (1-3),  in  which 

signals  are  confined  to  the  first  M  columns  o.  a  array.  Fbr  M=l,  the  two  mod¬ 

els  are  equivalent  ways  of  allowing  the  signal  in  t  ^  first  column  to  be  arbitrary,  and 
the  equality  of  the  tests  is  obvious.  Fbr  M  >  1.  the  models  coincide  only  if  the  freedom 
conferred  by  the  dimensionality  of  the  subspace  (in  the  generalized  problem)  is 
sufficient  to  overcome  the  fact  that  the  signals  from  the  first  M  columns  must  lie  in 
the  same  J-dimensional  subspace. 

Equation  (2-57)  was  a  convenient  starting  point  for  the  problem  generalization 
just  discussed,  because  al’  the  dependence  of  the  test  statistic  on  the  a  array  appears 
in  a  simple  and  explicit  way  in  this  formula.  An  analogous  expression,  in  which  all 
the  T-dependence  is  exhibited  in  the  same  simple  way,  also  can  be  obtained  This  form 
will  not  contain  the  matrix  S  explicitly,  since  the  formation  of  that  matrix  carries 
with  it  an  implicit  dependence  on  t  through  the  p  and  q  arrays. 

We  begin  with  Equation  (2-42),  and  rewrite  it  in  the  form 


I 


|(1„  4-  2”PZp)'‘i 
|(l„  +  z^s-'Zp)-'!  ■ 


(2-62) 


where  P  is  the  matrix  defined  in  Equation  (2-40).  We  use  the  generalized  Woodbury 
identity.  Equation  (Al-5),  to  evaluate  the  matrix  in  the  denominator 

(1„  +  zJs-'Zp)-'  =  I„  -  zJ(S  +  ZpZ”)-'Zp 

We  make  the  definition 

E  S  +  ZpZp  =  ZZ“  .  (2-63) 

thereby  giving  a  name  to  a  matrix  which  has  already  entered  our  previous  form  for 
the  test  statistic.  is  proportional  to  the  sample  covariance  matrix  based  on  all  the 
data  vectors  which  comprise  the  Z  array.  We  make  use  of  the  first  of  Equations  (2-10), 
together  with  the  new  definition,  and  write 

(i„  +  z“s-‘Zpr’  =  i„  -  z“s;'Zp  =  pd,,  -  z"s:'z)p" 
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We  can  therefore  write  the  test  statistic  in  the  form 


I  = 


KIm  +  2»PZp)-N 
Ip(Il  -  2”s;'z)p”i 


(2-64) 


The  denominator  now  has  the  desired  structure,  with  all  the  p«dependence  in  the 
outer  factors  of  a  matrix  product  The  numerator,  however,  requires  a  little  coercion. 
We  introduce  some  temporary  notation  to  simplify  the  writing,  as  follows: 


F  =  e”s;‘Zp 

(2-65) 

Next,  we  use  the  Woodbury  formula  again,  this  time  to  express  the  inverse  of  S  in 
terms  of  S^: 


S'’  =  (s,  -  ZpZ“)*‘  =  s:’  +  s:’ZpW-’z“s:’ .  (z-es) 

To  evaluate  the  numerator  of  Equation  (8-64),  we  require  the  following  results, 
which  are  direct  consequences  of  Equation  (2-66)  and  the  new  definitions: 

e’^S'^e  =  G  +  FW’f” 

e"s'’Zp  =  F  +  FW'’(1^  -  W)  -  FW'‘  .  (2-67) 

We  have  already  seen  that 

1„  +  z"s-'Zp  =  (i„  -  z^s;'z")-'  -  v»-‘ 

Combining  all  these  results,  and  recalling  definition  (2-40),  we  obtain 
1,^  +  ZpPZp  =  W*’  -  W’ f’’(G  +  F  W’f”)'*  FW’ 

=  (w  +  f”g'’f)'’  , 
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again  with  the  help  of  the  indispensable  Woodbury  identity.  We  now  substitute  from 
definitions  (3-65)  and  write 

W  +  =  1m  -  zjQZp  =  p(1l  -  Z»QZ)p»  . 

where 

Q  s  s;'  -  s;'e(e"s;‘e)'’  €”s;’  .  (2-68) 

The  new  matrix  Q  is  closely  analogous  to  P,  but  Q  involves  S.^  where  P  has  S  itself. 
Finally,  we  obtain  the  desired  form 

^  Ip(1l  -  Z»QZ)p»i  _  |t(1,^-  Z»QZ)t»| 

Ip(Il  -  z“s:4)p“|  "  |t(1l  -  z"s;‘z)t”i 

FYoin  definition  (2-63).  we  see  that 

1l  -  z“s;’z  =  1l  -  z“(zz”)'‘z 

is  a  projection  matrix.  In  fact,  it  projects  onto  the  orthogonal  complement  of  the  row 
space  of  the  data  array  Z.  For  fixed  p.  the  denominator  of  Equation  (2-69)  is  positive 
with  probability  one,  since  its  inverse  is  the  numerator  of  Equation  (2-42).  The  latter 
is  finite  (with  probability  one),  so  long  as  our  basic  constraint  L^N+  M  is  satisfied,  Fbr 
fixed  data,  however,  we  cannot  generalize  our  GLR  test  by  letting  r  be  arbitrary  (as 
we  were  able  to  generalize  it  earlier  by  letting  o  be  an  arbitrary  array),  since  the 
rows  of  T  could  always  be  chosen  from  the  row  space  of  Z.  thus  making  the  denomi¬ 
nator  of  Equation  (2-69)  vanish.  This  is  another  example  of  a  statistical  model  which 
provides  too  much  freedom  in  the  parameters  to  sustain  a  meaningful  decision  rule. 

With  suitable  constraints  on  r.  Equation  (2-69)  could  be  made  the  basis  of  a  gen¬ 
eralization  of  our  basic  GLR  test,  but  this  topic  will  not  be  pursued  further  here.  This 
equation  does,  however,  provide  us  with  a  useful  property  of  the  basic  GLR  test,  which 
may  be  mentioned  at  this  point.  Suppose  that  t  can  be  expressed  in  the  form 
t=TiWl.  where  Tj  is  another  MxL  array  of  rank  M.  and  where  W^^  is  a  unitary 
matrix  of  order  L  If  this  representation  for  t  is  substituted  in  Equation  (2-69),  the 
equation  will  have  the  same  form  as  before,  but  with  t  replaced  by  Tj,  and  with  Z 
replaced  by  Zj  =  ZUl  This  replacement  for  Z  also  may  be  made  in  the  formula  for 
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without  changing  that  matrix.  Since  Q  depends  on  Z  only  through  S^.  we  see  that  the 
simultaneous  replacement  of  t  by  Tj  and  Z  by  Zj  leaves  the  test  statistic  unaltered. 
When  Z  is  considered  as  a  random  array,  the  post-multiplication  by  does  not 
change  its  covariance,  as  we  can  see  from  Equations  (1-5)  and  (1-6)  of  Section  1.  The 
mean  value  of  Z  is  altered,  of  course,  as  shown  by  Equation  (1-7).  The  effect  is  simply 
to  replace  t  by  7Wl  =  Tj  in  the  formula  for  the  mean.  We  conclude  that  the  perform¬ 
ance  of  the  GLR  test,  as  a  detection  criterion,  is  unchanged  if  the  t  array  is 
post-multiplied  by  any  unitary  matrix.  In  particular,  t  can  be  converted  to  a  form  in 
which  all  but  the  first  M  columns  are  identically  zero,  by  means  of  a  suitable  unitary 
transformation.  We  will  encounter  this  invariance  property  again  in  Section  6. 

In  Section  3,  the  performance  of  the  GLR  test  will  be  studied  starting  from  Equa¬ 
tion  (2-42).  An  algorithm  for  the  efficient  computation  of  this  expression  is  presented 
in  Appendix  7.  This  is  a  “square-root”  algorithm  which  uses  standard  signal  process¬ 
ing  techniques  applied  to  the  data  arrays  themselves,  and  it  avoids  the  computation 
and  inversion  of  the  sample  covariance  matrices.  In  Appendix  1,  we  show  that  the 
same  performance  results  can  be  derived  directly  from  Equation  (2-56),  and  a 
square-root  algorithm  for  the  computation  of  the  GLR  test  statistic  in  this  form  also 
can  be  devised  This  algorithm  is  also  discussed  in  Appendix  7. 
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3.  STATISTICAL  PROPERTIES  OF  THE  GLR  TEST  STATISTIC 


We  turn  now  to  the  statistical  properties  of  the  test  statistic,  given  by  Equa¬ 
tion  (2-42).  Recall  the  arrays  e  and  f,  defined  in  Equations  (2-17)  and  (2-19).  with  their 
properties  as  derived  in  Section  2.  Together  they  form  a  unitary  matrix 
[EqU  '-ion  (2-20)].  which  we  now  use  to  decompose  both  Zp  and  Zq  into  further  com¬ 
ponents.  We  define 


and 


uRzp  = 


uKZq  = 


fe«Zpl 

Za 

i\\ 

Zb 

[e"z,l 

Wa 

lf"2. 

in  analogy  to  Equation  (2-16).  so  that 


(3-1) 


(3-2) 


Zp  —  e  Z^  +  f  Zg 

Zq  =  eW^  +  f  Wg  .  (3-3) 


We  have  now  resolved  the  data  array  Z  into  four  components; 


ulJzu" 


Za  w/ 

e»Zp»  e«Zq»' 

Zb  Wg 

f«Zp«  f«Zq», 

(3-4) 


where  is  the  unitary  matrix  defined  in  Equation  (2-12).  The  A-components  of  the 
new  arrays  have  J  rows,  and  the  B-components  consist  of  the  remaining  (N  -  J)  rows. 

We  also  define 


Saa 

^AB 

e“Se 

e”Sf 

.  ^BA 

f”Se 

f”Sf  . 

(3-5) 


and  its  inverse 
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(3-6) 


’Un  - 

gAA 

gAB 

e”s'^e  e”s'‘f 

gBA 

A 

gBB 

J 

f^S'^e  f“s'‘f 

The  AA-portions  of  these  arrays  are  (JxJ)  in  dimension,  and  the  BB-parts  are  also 
square,  of  dimension  (N  -  J).  The  transformed  S  array  may  also  be  expressed  in  terms 
of  the  W-components.  as  follows: 


^nSUn  = 


’'a*'" 

WbWJ 


WaWS 

■ur  tirH 


(3-7) 


We  introduce  a  «■'  n  .ar  notation  for  the  components  of  the  actual  covariance  matrix 
after  transform <.t, ion  by  Uj^j: 


u;jEu^. 


^AA  ^AB 
^BA  ^BB 


(3-8) 


together  with  an  analogous  terminology  for  its  inverse: 


uJr'uB 


j,AA  j,AB 
jaBA  jaBB 


(3-9) 


In  terms  of  the  new  components,  we  have 


ZpS'^Zp 


gAA  gAB 

Za 

gBA  gBB 

Zb 

and,  using  Equation  (Al-9)  of  Appendix  1,  we  obtain 

zJs'^Zp  =  +  zSSqJZb  . 


(3-10) 


where 
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(3-11) 


Y  =  -  S^B  SgB  Zb  ■ 

Using  these  results,  the  numerator  of  the  test  statistic  [Equation  (2*42)]  becomes 
Hm  +  ZbSbb^b  +  Y^s'^^YI 

FVom  the  definition  of  P  [Equation  (2*40)]  we  see  that  Pe  =  0  and  e^P  =  0.  Then, 
using  the  first  of  Equations  (3*3),  it  follows  that 

ZpPZp  =  Zj  f“Pf  Zb  (3-12) 

Moreover,  w'th  the  help  of  Equations  (Al-0)  of  Appendix  1  and  Equation  (3-6),  we  find 
that 


f”pf 


3BB 


and,  consequently,  the  GLR  test  statistic  can  be  written 

^  il„  *  2gSBl,ZB  y'<S*»Y! 

I*M 

This  expression  obviously  depends  on  the  subspace  decompositions  which  have  been 
introduced,  but  it  is  invariant  to  any  changes  in  the  actual  bases  defined  in  them. 

According  to  Equation  (3-6).  we  have 

e”s'‘e  =  , 


and  we  also  find  that 

e”s'^Zp  =  s'^^Za  ^  S^®Zb  . 

These  results  allow  us  to  evaluate  the  ML  estimator  of  the  signal  amplitude  array 
[Equation  (2-34)]  in  terms  of  quantities  introduced  in  this  section.  Using  Equa¬ 
tion  (Al-8)  again,  we  obtain 
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(3-13) 


b  =  S^®Zb 


We  now  define  the  quantities 


■'■  ZeSgaZg 

V  s  Yqj^ 

T  =  . 

which  allow  us  to  express  the  test  in  the  desired  form: 


(3-14) 


I 


|Cm  +  Y^T'^Y 


1C 


|ly  +  v”t‘W|  . 


(3-15) 


This  quantity  is  a  complex  analog  of  the  so-called  Wilks’  Lambda  statistic,  which 
arises  in  many  applications  of  the  multivariate  analysis  of  variance.  Fbr  the  case  of 
real  variables,  a  test  statistic  analogous  to  Equation  (3-15)  is  known.^’®  It  should  be 
noted  that  the  definition  of  V  depends  on  the  particular  way  in  which  was  fac¬ 
tored  to  form  a  square-root  matrix.  The  matrix  could  also  have  been  represented 
in  terms  of  Cholesky  factors,  and  an  equation  identical  to  Equation  (3-15)  obtained, 
With  an  appropriate  V  array.  This  freedom  of  choice  cannot  affect  the  statistical 
character  of  the  GLR  test  statistic,  and  it  is  actually  a  useful  feature  in  some  cases. 
The  point  is  taken  up  again  in  Section  6. 

It  is  interesting  to  compare  the  form  of  this  GLR  test  with  the  simpler  result 
found  in  Section  2  for  the  non-adaptive  problem  (i.e.,  the  case  of  known  E).  With  the 
notation  introduced  here,  we  can  express  the  non-adaptive  ML  estimator  of  b 
[Equation  (2-51)]  in  the  form 

bj,  =  (E''^)‘^E^^Zy^  +  E'^^Zg) 
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The  second  line  of  this  equation  expresses  the  estimator  as  the  difference  between 
and  its  conditional  expectation  given  Zg.  The  latter  term  is  the  predictable  portion  of 
the  random  noise  part  of  Zy^.  and  the  estimator  can  be  viewed  as  the  prediction  error. 
This  makes  sense  as  an  estimator,  since  the  expected  value  of  Zy^  is  the  true  value  of 
b  (see  below).  Conditional  expectations  and  linear  prediction  are  discussed  in  Appen¬ 
dix  1.  Fbrmula  (3-13)  shows  that  the  estimator  in  the  adaptive  case  (unknown  E)  has 
the  same  form  as  Equation  (3-16),  but  with  E  replaced  by  an  estimator  of  covariance, 
namely  the  one  defined  in  Equation  (2-48). 

In  the  non-adaptive  problem,  the  GLR  test  statistic  is  given  by  Equation  (2-52), 
which  may  be  restated  as 

X  =  ’lv[b”E'^^bj;]  .  (3-17) 

The  trace  operation  describes  non-coherent  integration  over  the  columns  of  bj,  and 
these,  in  turn,  depend  only  on  Zy^  and  Zg.  the  components  of  Zp.  The  Z^  component  of 
the  data  array  is  not  used  at  all  in  the  test,  since,  in  the  non-adaptive  case,  it  con¬ 
tains  no  information  of  use  for  the  detection  problem. 

As  noted  in  Appendix  1,  the  matrix  E^^  is  the  inverse  of  the  covariance  matrix 
shared  by  the  independent  columns  of  bj.  inasmuch  as  they  may  be  interpreted  as 
prediction  errors.  Thus,  each  term  of  the  trace  on  the  right  side  of  Equation  (3-17) 
itself  represents  a  form  of  non-coherent  integration  (following  a  suitable  whitening 
operation)  over  the  J  components  of  each  column  of  the  estimator.  This  is  a  logical 
way  of  detecting  the  presence  of  a  signal  specified  only  as  a  vector  in  a  subspace  of 
dimension  greater  than  unity.  The  formation  of  bj  itself  is  an  application  of  coherent 
integration,  which  takes  account  of  the  structure  of  the  actual  signals  that  determine 
the  subspace.  This  may  be  seen  by  referring  to  the  original  definition  [Equation  (2-51)] 
of  this  estimator,  which  depends  on  the  data  array  through  the  term 

e^E'^Zp  =  ((t"c7)’‘^<t“e'‘Zp  . 

H  *1 

The  array  a  E  Zp  which  appears  on  the  right  side  of  this  formula  may  be  inter¬ 
preted  as  comprising  the  outputs  of  a  set  of  colored-noise  matched  filters,  which  are 
matched  to  the  columns  of  the  signal  array  a  and  applied  to  the  columns  of  Zp. 
These,  in  turn,  are  formed  by  coherent  integration  along  the  rows  of  Z. 

In  the  adaptive  problem,  the  columns  of  the  ML  signal  parameter  estimator  b  are 
correlated,  because  they  all  use  the  same  estimator  of  covariance.  It  will  be  shown 
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below  that  this  correlation  is  described  by  the  matrix  C^.  and  it  is  removed  in  the 
formation  of  the  GLR  test  statistic  by  the  transition  from  the  Y  array  to  V.  Except 
for  a  constant  factor,  the  matrix  T  of  this  statistic  is  just  like  the  inverse  of  but 
using  the  estimated  covariance  matrix  instead  of  the  known  one.  Thus,  the  general 
GLR  test  is  built  with  structures  quite  similar  to  those  which  appear  in  its 
non-adaptive  analog.  The  final  form,  however,  appears  to  be  quite  different,  since  it 
involves  a  determinant  instead  of  a  trace.  This  distinction  disappears  when  we  con¬ 
sider  the  limiting  process  by  which  the  adaptive  problem  tends  toward  the 
non-adaptive  one,  namely  the  unbounded  growth  of  L  -  M.  This  is  the  number  of  data 
array  columns  in  excess  of  M,  the  dimensionality  of  the  signal-defining  t  array. 

Without  attempting  to  be  precise,  we  can  say  that  the  covariance  estimator  given 
in  Equation  (2-48)  will  tend  to  the  true  covariance  in  this  limit,  and  write 

S  (L-M)E  . 

The  inverse  of  S  therefore  beccn.es  smaller  as  L  increases.  In  the  limit,  becomes 
the  identity  matrix,  as  the  second  term  in  its  definition  [see  Equation  (3-14)]  becomes 
vanishingly  small  Hence,  in  this  limit,  the  correlation  between  the  columns  of  b  disap¬ 
pears.  Then. 


^  A 

b  -♦  bj- 

and  also 


T'l 


gAA 


1  ^AA 

L-M 


so  that 


1 

L-M 


^AA  r 


In  this  form,  the  GLR  test  statistic  is  the  determinant  of  the  sum  of  the  identity 
matrix  and  a  "small"  term,  so  that  we  obtain 


I 


I'm*  Er“s‘'Stl 


X 

L-M  ■ 
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Thus,  heuristically  at  least,  the  GLR  test  for  the  adaptive  problem  goes  over  into  that 
for  the  non-adaptive  case  in  the  appropriate  limiting  situation. 

FVoni  this  discussion,  it  follows  that  the  simpler  decision  rule 
Tr(V^T  W)  >  Constant  . 


should  perform  well  for  la^ge  values  of  L.  The  analog  of  this  detector  with  real  vari¬ 
ables  is  known  as  the  Ixiwley-Hotelling  test.*® 

Until  now,  the  data  array  has  been  considered  as  a  given  set  of  complex  num¬ 
bers,  while  the  parameters  characterizing  the  statistical  model,  namely  B  and  E,  have 
been  treated  as  variables  for  the  derivation  of  the  GLR  test.  To  evaluate  the  perform¬ 
ance  of  the  test,  these  parameters  must  be  considered  fixed  and  given,  while  the  ele¬ 
ments  of  the  data  array  are  considered  to  be  random  variables.  The  remainder  of  this 
section  is  devoted  to  establi.shing  the  statistical  properties  of  the  test  statistic. 

Suppose  that  the  true  signal  parameter  array  is  B  and  that  the  actual  covari¬ 
ance  matrix  of  the  columns  of  Z  is  E.  Then. 

EZ  =  oBt  =  ebp  .  (3-18) 


and 


Cov(Z)  =  SoIl 

The  mean  value  of  the  transformed  data  array  will  be 

.Hi  f  ^  Q 


EUUZUJ  ^ 


f^ 


H 


ebp  Ip  q 


(3-19) 


(3-20) 


and  its  covariance,  using  formula  (Al-4'1)  of  Appendix  1,  will  be 

Cov(uJ!zuJ)  =  (uSeUn)®Il 

Comparing  Equation  (3-20)  with  Equation  (3-4),  we  see  that  the  expected  value  of 
is  just  b,  while  the  other  three  components  of  the  transformed  array  have  zero  mean. 
The  columns  of  the  transformed  array  are  still  independent,  and  they  now  share  the 
covuriance  matrix  which  has  been  expressed  in  component  form  in  Equation  (3-8) 
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Note  that  the  situation  corresponding  to  the  "true"  parameters,  as  described  by 
Equations  (3-18)  and  (3-19)  above,  coincides  exactly  with  the  model  postulated  in  Equa¬ 
tions  (1-1)  and  (1-2)  of  Section  1.  We  refer  to  thi  ?  as  the  "matched”  situation.  It  is 
Interesting  to  consider  the  effect  of  various  departures  from  this  matched  condition 
on  the  performance  of  the  GLR  test.  At  the  end  of  this  section  we  introduce  a  partic¬ 
ular  form  of  "mismatch"  which  proves  to  be  amenable  to  analysis,  and  take  up  its 
implications  in  Sections  5  and  6. 

To  proceed,  we  first  fix  the  arrays  Zg  and  Wg,  and  we  refer  to  this  conditioning 
by  using  the  subscript  B.  Referring  again  to  Appendix  1  for  details,  we  have  the  fol¬ 
lowing  conditional  expectations: 

EgZy^  =  b  +  •  (3“21) 


and 


Eb'Va  =  (3-22) 

FVorn  Equation  (3-7).  we  see  that 

Y  =  z,  -  w.wgsiJzo  . 

hence,  Y  is  a  Gaussian  array  under  the  conditioning,  with  conditional  expectavion 

Eg  Y  -  b  +  Ey^g  Egg  Zg  “  Ey^g  Egg  WgWg  Sgg  Zg 
But  WgWg  =  Sggi  thcrcfore, 

EgY  =  b  .  (3-23) 

Finally,  using  Equations  (3-14),  we  obtain 

EgV  .-=  bCij^  .  (3-24) 

We  note  that  the  matrix  depends  only  on  quantities  fixed  under  the  conditioning, 
and  it  may  therefore  be  treated  as  a  constant  as  long  as  the  conditioning  holds. 
Therefore,  V  itself  is  conditionally  o  Gaussian  random  array. 
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Since  the  columns  of  the  transformed  data  array  are  all  independent,  the  condi* 
tioning  variables  only  affect  their  own  columns.  It  follows  that  the  conditional  covari¬ 
ance  of  any  of  the  columns  of  or  is  given  by 

(2^^)  1  -  S^bEbb^ba  • 

using  a  standard  property  of  Gaussian  random  variables,  reviewed  in  Appendix  1.  We 
can  therefore  describe  the  conditional  covariance  properties  of  and  together  by 
the  statement 

Covadz^Wj)  =  (3-25) 

To  evaluate  the  covariance  properties  of  Y  and  V,  it  is  convenient  to  write 

V  =  Z*  -  Wa«  =  |Za  wJ 

where  Q  is  defined  by 

Q^wSSbJZb.  (3-26) 

Then,  using  Equation  (Al-44)  of  Appendix  1,  we  have 

Covb(Y)  =  (E^'^)'‘®(1m  +q"q)*  . 

But  it  is  easily  verified  that 

Q^Q  =  ZbSbbZb  . 

and,  thus,  Y  has  the  covariance  matrix 

Covb(Y)  =  (E^^‘‘®Cm  .  (3-27) 

Sinc  e  Y  is  actually  the  ML  estimator  of  the  signal  parameter  array  b.  Equation  (3-27) 
expresses  the  conditional  correlation  between  the  columns  of  this  estimator  which 
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was  mentioned  earlier.  A  fuller  discussion,  including  the  effect  of  removing  the  condi¬ 
tioning  for  this  estimator,  is  given  in  Section  5. 

Recalling  the  definition  of  V,  and  using  the  same  covariance  identity,  we  find  that 
the  columns  of  V  are  independent  under  the  conditioning. 

Covb(V)  =  .  (3-28) 

It  is  useful  to  write  V  as  the  sum  of  two  parts: 

V  -  4-  V„  .  (3-29) 

where 

Vs-bCjf.  (3-30) 

Then  which  we  may  call  the  "noise  component,"  is  a  complex  Gaussian  array, 
with  zero  mean  and  covariance  ;^;ven  by  Equation  (3-28).  independent  of  the  condi¬ 
tioning  variables  which  appear  only  in  the  "signal  component”  V^. 

Uirning  now  to  the  T  array,  we  recall  that  T  is  the  inverse  of  and  that  the 
matrix 


^AA  ^AB 
^BA  ^BB 


is  a  complex  Wisharl  matrix,  of  order  N.  with  L-M  complex  degrees  of  freedom.  The 
unconditioned  means  of  and  Wg  are  zero,  and  from  Equations  (3-2)  and  (A1  -44)  we 
obtain  the  unconditioned  covariance 


Cov 


The  partitioned  form  of  the  transformed  E  matrix  is  given  by  Equation  (3-8) 

Some  of  the  properties  of  Wishart  matrices  are  discussed  in  Appendix  1,  where  it 
is  proved  that  a  matrix  such  as  T,  which  is  the  inverse  of  a  diagonal  block  of  a  parti¬ 
tioned  complex  Wishart  matrix,  is  also  a  complex  Wishart  matrix  of  an  appropriate 
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order  and  with  a  reduced  number  of  complex  degrees  of  freedom.  In  the  case  of  T.  the 
dimension  is  J  and  the  number  of  complex  degrees  of  freedom  is  L  +  J  -  N  -  M.  Fbom 
the  results  of  Appendix  1  it  also  follows  that  T  is  independent  of  S^g.  These  facts  are 
established  in  Appendix  1  first  under  conditioning  on  the  B  components,  but  the 
probability  density  function  of  T  does  not  depend  on  the  values  of  the  conditioning 
variables.  Therefore,  the  complex  Wishart  character  of  T.  as  well  as  its  independence  of 
S^g.  remains  true  when  the  conditioning  is  removed.  By  the  same  argument,  T  is 
proved  to  be  unconditionally  independent  of  S^gSgg.  because  the  second  factor  of  this 
product  is  constant  under  the  conditioning.  Since  T  is  formed  from  and  Wg.  it  is 
clearly  independent  of  the  components  2^^  and  2g.  Thus.  T  is  unconditionally  indepen¬ 
dent  of  Y.  as  defined  by  Equation  (3-11).  and  also  of  and  V.  defined  in  Equa¬ 
tions  (3-14).  T  can  be  expressed  in  terms  of  a  Gaussian  array,  say  W.  of  dimension 
J  X  (L  +  J  -  N  -  M).  as  follows: 

T  =  WW”  .  (3-31) 


The  mean  of  W  is  zero,  and  its  covariance  is 


Cov(W)  -  (E^^)  'sIl+j.N-M  • 


(3-32) 


a  property  established  in  Appendix  1. 

The  last  step  in  the  statistical  characterization  of  the  test  statistic  is  a 
"whitening"  operation.  With  the  conditioning  on  the  B-components  still  in  effect,  we 
define  the  new  arrays 


Vq  =  (E^^)*^  V 

To  s  (e'^^)‘^T(e''^'^  .  (3-33) 

using  the  subscript  zero  to  indicate  the  whitening.  The  matrix  Tq  is  also  a  complex 
Wishart  matrix,  and  it  can  be  expressed  in  terms  of  a  new  zero-mean  complex  Gauss¬ 
ian  array  Wq  (unrelated  to  W^^  and  Wg); 


To  ^  WqWS 


(3-34) 


These  new  arrays  have  identity  matrices  for  their  covariances: 
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COVg(VQ)  -  Ij  ® 

Covg(WQ)  =  Ij®Il+j-n-m  •  (3-35) 

Thus,  all  the  elements  of  these  arrays  are  conditionally  independent.  The  whitened 
array  Vq  is  made  up  of  the  components 

Vq  =  Vq,  +  Vo„  .  (3-3n 

where  is  a  complex  Gaussian  array,  with  zero  mean  and  covariance  equal  to  the 
identity,  and  where 

Vo3  ^  (3-37) 


The  columns  of  the  conditioning  arrays  Zg  and  Wg  share  the  covariance  matrix 
Egg.  The  marginal  probability  density  functions  of  these  arrays  are  direct  analogs  of 
Equation  (Al-79)  of  Appendix  1.  These  arrays  are  now  also  whitened,  with  the  intro¬ 
duction  of  the  new  quantities 


Zgo  ®  (^Bb)  ^B 
"bo  •  (2:6b)"^  Wb 


(3-38) 


The  whitened  arrays  have  zero  means;  their  covariance  matrices  are  given  by 
Cov(Zgo)  = 

Cov(WgQ)  =  (3-39) 


The  whitening  matrix  cancels  out  in  the  formation  of  Cj^,  which  has  the  same 
structure  in  terms  of  ZgQ  and  WgQ: 

~  ZgQ(WgQWgQ)  '  Zgo  (3'40) 


Finally,  the  test  statistic  also  retains  its  form  when  expressed  in  terms  of  the  whit¬ 
ened  arrays  Vq  and  Wq; 

i  =  IIm+^S'To’Vo;.  (3-41) 
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and  this  is  the  form  which  is  analyzed  in  later  sections.  We  note  that  the  original 
covariance  matrix  2  survives  only  in  the  "signal"  array  Vq^.  The  conditioning  vari¬ 
ables  Zbo  and  WgQ  are  also  confined  to  that  component,  entering  through  its  depen¬ 
dence  on  the  array. 

We  can  therefore  state  that  Vq^,  and  Wq  are  (unconditionally)  independent  com¬ 
plex  Gaussian  arrays,  with  zero  means  and  covariance  matrices  given  by  the  right 
sides  of  Equations  (3-35).  and  that  Tq  is  subject  to  a  complex  Wishart  distribution  of 
dimension  J,  with  L  +  J  -  N  -  M  complex  degrees  of  freedom.  Tq  is  expressed  in  terms  of 
Wq  by  Equation  (3-34).  Fbom  this  point  forward,  unless  explicitly  stated  otherwise, 
when  we  say  that  a  matrix  is  complex  Wishart  we  mean  that  it  has  a  form  corre¬ 
sponding  to  Equation  (3-31).  and  that  the  covariance  matrix  of  the  underlying  Gauss¬ 
ian  array  is  a  Kronecker  product  of  identity  matrices. 

The  test  statistic  is  expressed  by  Equation  (3-41)  end  Vq  is  given  by  Equa¬ 
tion  (3-36).  Moreover,  Vq,  is  independent  of  Vq^  and  Wq.  lb  compute  the  probability  of 
detection  (PD)  one  can,  in  principle,  begin  by  conditioning  on  Vq,  itself,  determine  the 
conditional  PD,  and  remove  the  conditioning  at  the  end.  The  statistical  character  of 
Vq,  is  required,  of  course,  and  this  is  discus.sed  in  Section  5  .  Fbr  the  probability  of 
false  alarm  (PFA),  however.  Vq^  vanishes  and  our  statistical  analysis  is  formally  com¬ 
plete  The  statistical  properties  of  the  test  can  depend  only  on  the  dimensional 
parameters  of  the  problem  (in  t‘\e  absence  of  signal);  hence,  the  GLR  test  is  a  CFAR 
decision  rule.  A  more  explicit  statistical  characterization  will  be  obtained  in  Section  4. 

The  possibility  of  "mismatch”  was  mentioned  earlier,  and  we  introduce  an 
example  of  it  here.  The  departure  from  the  modeled  situation  relates  only  to  the  sig¬ 
nal  component;  hence,  it  will  have  no  effect  on  the  discussion  of  false  alarm  probabil¬ 
ity  in  the  next  section  We  suppose  that  the  true  mean  of  the  data  array  is  not  given 
by  Equation  (3-18),  but  instead  has  the  more  general  form 

EZ  =  Dt  s  dp  .  (3-42) 


The  case  of  a  completely  arbitrary  mean  value  of  Z  is  certainly  interesting,  but  its 
analysis  appears  to  present  considerable  difficulties.  With  the  new  model.  Equa¬ 
tion  (3-20)  is  replaced  by 


EU«ZU« 


J  I  H  H. 

dp  Ip  q  I 


b,  0 

be  0 


(3-43) 


where 
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=  e”d 
be  -  f”d 

d  -  .  (3-44) 

According  to  Equation  (3-43),  the  components  and  Wg  retain  their  zero  means,  but 
now 


EZa  =  W. 

and 

In  the  ana!)  :is  ol'  the  matched  problem,  we  began  by  conditioning  on  the  B  'rK>vn* 
ponents  Zp  ar.j  Wg  Formula  (3-22)  remains  valid  for  the  conditional  mean  of  W^,  but 
Elquation  (3-21)  mast  now  be  replaced  by 

Eb^a  “  ^a  (Zg  --  bg)  .  (3-45) 

This  is  a  direct  analog  of  Equation  (Al-81)  in  Appendix  1.  The  conditional  mean  of  Y  is 
evaluated  as  before,  but  p.ov  with  the  result 

EbY  =  by^  -  •  (3-46) 

The  conditional  covariance  of  Y  is  .still  correctly  expressed  by  Equation  (3-27).  with  Cy 
as  defined  by  Equation  (3-14).  The  effect  of  the  non-vanishing  mean  value  of  Zg  which 
enters  this  definition  will  be  felt  when  the  conditioning  is  removed  later. 

After  the  transition  to  whitened  arrays.  Equation  (3-37)  becomes 

Vo,  -  (S“r(b,-!:ABSBBt>B)CM'^  ■  O-IV) 

Expression  (3-40),  which  defines  in  terms  of  these  whitened  arrays,  remains  cor¬ 
rect,  but  now 


EZgo  -  (Sgg) 


■VZ 


BB> 


(3-48) 
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These  results  will  be  utilized  in  Sections  5  and  6.  where  the  effects  of  this  kind  of 
mismatch  are  studied  in  terms  of  signal  parameter  estintation  and  probability  of 
detection. 
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4.  THE  PROBABIUTY  OF  FALSE  ALARM 


The  fundamental  problem  of  performance  analysis  is  the  computation  of  the 
probability  of  accepting  hypothesis  Hj  by  means  of  the  GLR  test:  The  general 

case  is  discussed  in  Section  6.  We  devote  this  section  to  the  evaluation  of  the  prob¬ 
ability  of  false  alarm  (PFA),  i.e..  the  probability  of  accepting  Hj  when  B  =  0.  We  simplify 
the  notation  of  Section  3  by  dropping  the  subscript  0  which  was  used  to  indicate  the 
whitening  of  various  arrays.  The  GLR  test  statistic,  given  by  Equation  (3-41),  again 
assumes  the  form 

/  =  Hm  +  V^T'Wl  .  (4-1) 


where 


T  = 


ww”  . 


(4-2) 


The  arrays  V  and  W  are  Gaussian,  independent  of  one  another,  and  they  both 
have  mean  value  zero.  We  introduce  the  new  parameter 


K  =  L-N-M  . 


(4-3) 


and  recall  that  K  ^  0  by  the  constraint  first  expressed  as  Equation  (1-9).  The  dimension 
of  V  is  J  X  M,  W  is  J  X  (J  4-  K).  and  the  covariances  of  these  arrays  are  given  by 

Cov(V)  =  Ij@Im 

Cov(W)  =  Ij©lj+K  •  (4-4) 

The  PFA  will  depend  only  on  J.  M,  and  K,  end  not  on  the  actual  covariance  matrix  E; 
hence,  the  GLR  test  has  the  CFAR  property.  The  only  change  when  signals  are  added 
will  be  the  addition  of  a  non-zero  mean  value  for  V. 

Using  Equation  (Al-2).  the  test  statistic  can  also  be  expressed  in  the  form 


IT  +  VV“| 
|T| 


(4-5) 
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2  0 

The  inverse  of  I  is  the  complex  analog  of  Wilks’  Lambda  statistic,  which  often 
arises  in  multivariate  statistical  analysis.  It  is  usual  in  that  context  to  test  for  the 
validity  of  Hq  against  Hj,  as  we  have  defined  the  hypotheses,  which  accounts  for  the 
inversion  of  the  test  statistic.  We  note  that  T  is  a  complex  Wishart  matrix  and  is 
non-singular  (with  probability  one),  but  that  VV  is  non-singular  only  when  M  ^  J. 

It  is  useful  to  consider  some  special  cases,  and  we  begin  with  the  simplest, 
namely  J  =  1,  with  arbitrary  M  and  non-negative  K.  Then,  V  and  W  are  row  vectors  and 
T  is  a  scalar: 


T  = 


WW”  =  J]  |w.|2  . 
j=l 


K+l 


where  the  Wj  are  the  elements  of  W.  Thus,  T  is  a  complex  chi-squared  variable,  with 
K  +  l  complex  degrees  of  freedom.  This  terminology  is  introduced  in  Appendix  2,  where 
a  discussion  of  the  complex  chi-squared  and  other  related  distributions  will  be  found. 

Using  Equation  (4-5),  the  test  statistic  takes  the  form 


^  =  1  + 


vv” 

T 


U 

and  VV  is  also  a  complex  chi-squared  variable: 


(4-6) 


vv« 


M 

is1 


with  M  complex  degrees  of  freedom.  The  ratio  of  complex  chi-squared  variables  which 
appears  in  Equation  (4-6)  is  subject  to  a  complex  central  F  distribution,  but  we  prefer 
to  express  the  test  statistic  in  the  form 


K+l 
1  =  1 


K+l  M 

I  +  E  I'-ii" 

j=i  1-1 


x^(K  +  l,M) 


(4-7) 
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In  this  formula,  the  notation  x^(n.m)  is  used  in  a  generic  sense  to  denote  a  random 
variable  which  obeys  the  complex  central  Beta  distribution,  whose  probability  density 
function  (pdf)  is  given  by  Equation  (A2-12)  of  Appendix  2.  The  PFA,  defined  by  the 
equation 


PFA  =  Prob(/>  Iq)  =  Prob[x^(K  +  l,M)<  \/Lq\  ,  (4-8) 

is  just  the  cumulative  of  the  complex  central  Beta  distribution,  also  presented  in 
Appendix  2.  Substituting  the  appropriate  parameter  values  in  Equation  (A2-14),  we 
obtain 


PfA  -  tjL  "j;  (M+Kj  (^.9, 

*0  m  =  0 

With  the  further  specialization  M=  1,  this  formula  reproduces  the  simple  result  found 
in  Reference  3; 


PFA  = 


I 


1_ 

K+l 


i 


L-N 


(4-10) 


The  other  special  case  we  wish  to  discuss  is  the  dual  version  in  which  M=l,  J  is 
arbitrary  J,  and  K  is  non-negative.  V  is  now  a  column  vector,  and 


/  =  1  +  v“t‘W  . 


The  T  matrix  is  of  order  J  and  satisfies  a  complex  Wishart  distribution  with  J  +  K 
complex  degrees  of  freedom.  T  is  expressed  in  terms  of  a  zero-mean  Gaussian  array  in 
Equation  (4-2).  The  covariance  matrix  of  this  array  is  the  identity,  as  stated  in  Equa¬ 
tion  (4-4).  As  noted  in  the  previous  section,  these  properties  of  the  underlying  Gauss¬ 
ian  array  will  be  tacitly  assumed  for  Wishart  matrices  in  the  following. 

We  define  the  unit  vector 

g  =  v(v”v)’‘^  . 

and  write 

^  =  1  +  (v”v)(g“T'‘g)  .  (4-11) 
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Obviously,  the  quantity 

v“v  =  5]  lvj2 

i=l 

is  a  complex  chi-squared  variable,  with  J  complex  degrees  of  freedom. 

The  unit  vector  g  may  be  considered  to  form  the  basis  for  a  one-dimensional 
subspace  of  and  thus,  according  to  the  general  property  of  Wishart  matrices  estab¬ 
lished  in  Appendix  1,  the  inverse  of  g”T“*g  is  also  subject  to  a  complex  Wishart  distri¬ 
bution.  This  latter  Wishart  matrix  is  simply  a  complex  chi-squared  variable  in  the 
present  case,  since  its  dimension  is  unity.  This  dimension  is  smaller  than  that  of  T  by 
J  - 1,  hence  the  complex  chi-squared  variable  has  K  + 1  complex  degrees  of  freedom, 
according  to  the  rule  derived  in  Appendix  1.  It  is  therefore  statistically  equivalent  to 
the  sum 


lg”T-'g) 


-1 


K+l 

El-/ 


j  =  i 


where  the  Wj  are  complex  Gaussian  variables  of  zero  mean  and  unit  variance.  These 
properties  are  independent  of  the  conditioning  variables,  hence  they  remain  true 
without  the  conditioning  which  is  now  removed.  Then,  Equation  (4-11)  can  be  written 


I 


(4-12) 


where  the  v-  are  independent  of  the  Wj.  In  other  words, 
\/l  --  x^(K-fl.J)  . 

Fbr  the  special  case  M  =  1,  we  have  therefore  found; 


(4-13) 


(4-14) 
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This  expression  is  in  agreement  with  the  corresponding  result  given  in  Reference  5. 

We  return  to  the  general  case  and  introduce  a  generic  notation  for  the  random 
matrix  which  appears  in  Equation  (4-1): 

ig(J.M.K)  =  Im  +  v“t‘W  .  (4-15) 

The  GLH  test  statistic  itself  is  given  a  more  specific  notation,  indicating  the  dimen¬ 
sional  parameters  to  which  it  relates: 

^(J.M.K)  =  |€(J,M.K):  =  li?(J,M.L-N-M)|  .  (4-16) 

It  is  useful  to  study  some  of  the  properties  of  these  quantities,  under  the  assumption 
that  V  and  W  are  independent,  zero-mean  Gaussian  arrays,  with  covariances  given  by 
Equation  (4-4).  By  its  very  structure,  the  iS  matrix  is  always  positive  definite,  and, 
when  M  =  1,  it  reduces  to  a  scalar  In  the  latter  case,  according  to  Equation  (4-13), 

f(J,l,K)  =  l/x^(K^l,J)  .  (4  17) 

Similarly,  when  J  =  1,  Equation  (4-7)  yields 

f(l,M,K)  =  l/x^(K  +  l.M)  .  (4-18) 

Equalities  such  as  these  are  meant  to  indicate  statistical  identity,  i.e.,  the  equality  of 
the  probability  density  functions  of  the  random  variables  which  enter  the  equation. 
These  two  results  constitute  a  particular  example  of  a  general  duality  property  which 
will  be  derived  later.  We  also  note  that  the  matrix  C^,  defined  by  Equation  (3-40).  is  of 
the  same  form,  namely. 

Cm  =  €(N-J,M,L  +  J-N-M)  =  «(N-J.M,J  +  K/  .  (4-19) 

This  matrix  plays  a  central  role  in  the  analysis  of  performance  under  hypothesis  Hj. 

Let  us  introduce  a  decomposition  of  the  vector  space  into  a  subrpace  of 
dimension  Jj  and  its  orthogonal  complement,  v/hose  dimension  will  be  The 

arrays  V  and  W  are  partitioned  as  follows: 
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V  = 


w  = 


Wc 


(4-20) 


and  we  have 


T  = 


w,w”  w,w” 


'r'l 

iX 


WoW”  w,w 


1"2 
H 


2"2 


II 

Tn 

Tiz' 

.'r2i 

T22 

(4-21) 


We  recall  that  T  is  a  connplex  Wishart  matrix  of  dimension  J.  with  J  +  K  degrees  of 
freedom,  and  that  the  covariance  of  W  is  given  by  Equation  (4-4). 

We  also  define 


T'  = 


T 

<p2l 


11  -12 


n22 


(4-22) 


and  then  substitute: 


yH  y-  1  Y 


=  [vr  V»1 


,j.ll  j\2 

j21  .p22 


f  V, 


(4-23) 


Making  use  of  identity  (Al-9)  of  Appendix  1,  we  obtain 

V«T-‘V  .  (V,-T,2T2>/t”(V,-T,2T^Vj)  +  V»T^Vj 


(4-24) 


By  adding  the  identity  matrix  to  Equation  (4-24),  we  can  express  W(J.M.K)  In  the 
form  of  a  product; 


t?(J.M,K)  =  (Im+V«T^^V2)'^(Im  ^"Tg^Vg) 


\V2 


H  47-1 


tH  rri  -  1 


\l/2 


(4-25) 


where 
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V  »  (V,-T.2T^V2)(I„+V«T2iVj)-« 


(4-26) 


and 


V  ^  =  Tj,  -  TiaT^Tgi  .  (4-27) 

The  arrays  Vg  and  Wg  are  Gaussian,  independent  of  one  another,  and  have  mean  val¬ 
ues  zero.  Their  covariances  are  given  by 

CovCVj)  = 

Cov(Wg)  =  +  ■ 

We  can  therefore  write 

Im  +v“Tg'^V2  =  t?(Jg.M,Ji  +  K)  .  (4-28) 

indicating  thereby  the  statistical  character  of  this  matrix  as  an  example  of  the  fam¬ 
ily  defined  by  Equation  (4-15).  It  is  directly  analogous  to  the  matrix  Cy  of  the  previ¬ 
ous  section. 

We  again  recall  the  analysis  of  Section  3,  which  may  be  applied  directly  to  the 
study  of  V  and  V.  These  quantities  correspond  to  V  and  T  of  that  section.  Conditioning 
on  Vg  and  Wg,  it  follows  that  is  a  zero-mean  Gaussian  array  with  covariance 

Cov(y)  =  . 

and  that  V  and  3  are  independent.  According  to  a  property  of  complex  Wishart 
matrices,  established  in  Appendix  1,  it  follows  that  5  is  a  complex  Wishart  matrix,  of 
dimension  Jj,  and  with  Jj  +  K  complex  degrees  of  freedom  Thus,  3  may  be  expressed  in 
the  form 


3  =  , 

where  is  a  zero-mean  Gaussian  array,  with  covariance 
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Cov(ir)  - 

All  these  statements  are  valid  under  the  conditioning,  but  they  do  not  involve  the 
conditioning  variables.  In  particular,  the  pdf  of  3  does  not  depend  on  these  variables. 
Hence,  these  statements  remain  true  without  the  conditioning,  which  we  now  remove. 
We  have  therefore  shown  that 

=  1(?(J,.M.K)  .  (4-29) 

again  using  this  notation  to  identify  the  statistical  character  of  this  matrix.  In  addi¬ 
tion,  since  the  statistical  properties  of  this  array  do  not  depend  on  the  conditioning 
variables,  it  follows  that  the  matrices  expressed  by  Equations  (4-28)  and  (4-29)  are 
themselves  independent. 

R'om  these  results,  we  obtain  the  basic  matrix  factorization  identity 

t?(J.M,K)  =  [tS(J;,.M.Ji  +  K)]'^ii?(J,.M.K)(l(?(J2.M.J,  +  K)]‘^  .  (4-30) 

and,  from  it,  the  recursion  relation 

^(J,M,K)  =  /(J-Jj,M,Ji  +  K)  ^(Jj.M.K)  .  (4-31) 

The  factors  on  the  right  are  independent,  and  the  recursion  holds  for  any  Jj<J. 
Choosing  Jj  =  1  and  iterating,  we  obtain  a  representation  in  terms  of  independent  fac¬ 
tors: 


J-: 

/(J.H.K)  -  n  .  (4-32) 

j-0 

The  factors  on  the  right  side  of  this  equation  correspond  to  the  special  case  J  =  1 
which  we  have  already  studied.  Thus,  using  Equation  (4-18),  we  have 

j 

1/^(J,M,K)  =  n  Xp(K  +  j,M)  .  (4-33) 

j=i 
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The  inverse  of  the  test  statistic  is  therefore  the  product  of  a  set  of  independent  com¬ 
plex  central  Beta  variables.  In  the  case  of  real  data.  Wilks'  Lambda  statistic  is  expres¬ 
sible  as  a  product  of  independent  real  central  Beta  variables,  with  a  sequence  of 
parameters  increasing  in  half-integral  steps.  Equation  (4-33).  which  refers  to  the  com¬ 
plex  version  of  Wilks’  statistic,  is  a  direct  analog.  (See  also  Reference  20,  where  this 
result  and  the  complex  analogs  of  a  number  of  other  statistical  theorems  concerning 
real  Gaussian  variables  are  stated.) 

We  have  also  shown  that 

/(l.M.K)  =  /(M.l.K)  .  (4-34) 

by  our  discussion  of  the  two  special  cases  at  the  start  of  this  section  As  a  special  case 
of  Equation  (4-33),  we  have 


M 

1//(M.1,K)  =  Yl  x^(K  +  m.l)  . 
m  =  l 


which,  together  with  Equations  (4-10)  and  (4-34).  yields  the  following  identity  among 
complex  central  Beta  variables. 

M 

x^(Ki-i,M)  =  x^(K  +  m,l)  .  (4-35) 

m-l 


The  factors  on  the  right  are,  of  course,  independent,  and  this  identity  can  easily  be 
verified  by  other  means.  Combining  these  results,  we  obtain  the  desired 
representation  of  the  GLR  test  statistic  as  a  double  product  of  JM  independent  factors; 

J  M 

1//(J,M,K)  =  n  n  Xp(K+j  +  m-l.l)  .  (4-36) 

J-l  ni=l 


The  notation  indicates  the  statistical  character  of  each  factor,  their  independence 
being  understood.  FVom  this  expression,  it  is  clear  that  J  and  M  may  be  interchanged 
without  change  to  the  PFA,  provided  only  that  K  remains  the  same.  This  generalizes 
the  duality  noted  earlier  in  this  section. 
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Equation  (4-36)  provides  a  formally  complete  statistical  characterization  of  the 
GLR  test  statistic  under  the  null  hypothesis.  Except  in  the  special  cases  already  evalu¬ 
ated  it  is,  however,  of  limited  utilit  as  a  '  xr  numerical  evaluation.  This  is  par- 
ticularly  true  in  radar  applications,  whe  FA  values  as  small  as  10  commonly 
occur.  Similar  difficulties  are  encountered  in  the  evaluation  of  the  real  Wilks'  statis- 
tic.  The  double-product  representation  is,  on  the  other  hand,  well  suited  to  evalua¬ 
tion  by  the  technique  of  numerical  integration  in  the  complex  plane,  following  a  con¬ 
tour  of  steepest  descent.  This  procedure  has  been  developed  and  successfully  applied 
to  a  number  of  detection  probability  evaluations  by  Helstrom,  building  on  earlier 
work  by  Rice.  The  analytical  techniques  involved  in  this  procedure  are  quite  unre¬ 
lated  to  those  used  elsewhere  in  this  study,  and  the  entire  topic  is  relegated  to 
Appendix  6. 

At  this  point  it  is  useful  to  derive  a  result  that  will  be  needed  in  the  next  Sec¬ 
tion.  We  return  to  the  definition  of  the  if  matrix  and  apply  a  unitary  transformation 
to  both  sides,  writing 

u“i?(J.M.K)U  =  !„  +  «J)”t'‘«1>  ,  (4-37) 


where 


*  =  V  U  . 

and  U  is  an  arbitrary  unitary  matrix  of  order  M.  Since  ♦  is  statistically  indistingui¬ 
shable  from  V,  the  joint  pdf  of  the  elements  of  tf(J,K,M)  must  also  be  invariant  to 
the  transformation  expressed  by  Equation  (4-37).  It  then  follows  that 

=  E(u“igU)"  =  u”e«"U  ,  (4-38) 

for  any  positive  or  negative  integer  n.  Since  Equation  (4-38)  holds  for  all  unitary 
matrices,  EiS*'  must  be  a  multiple  of  the  identity  matrix. 

We  are  particularly  interested  in  the  first  moment  of  if,  and  we  make  the  defini¬ 
tion 


E«(J,M,K)  H  /i(J,M,K)lM  . 

Taking  che  trace  of  both  sides  of  this  equation,  we  have 


(4-39) 


56 


(4-40) 


A((J.M.K)  =  W’  ETrt?(J.M.K) 

=  1  +M'*  ETr(T'Wv“)  . 

But  T  and  V  are  independent,  and 
EVV”  =  MIj  . 

according  to  Equation  (Al-42)  The  dependence  on  M  therefore  disappears,  and 


=  1  +  E  Tr(T'’)  . 

If  we  take  the  trace  of  both  sides  of  the  factorization  formula  [Equation  (4-30)]  and 
recall  the  independence  of  the  factors,  we  obtain  the  recursion 

m(J,M,K)  =  /i(J-Ji,M,Ji  +  K)/z(J,.M.K)  . 

This  is  just  like  Equation  (4-31).  and  by  iteration  we  find 


J-i 

m(J.M.K)  =  n  Ml.M.K+j)  . 

j  =  0 


When  J  =  1,  Equation  (4-40)  yields 


^(l.M.K)  =  1  +  M'^E 


M 

Eiv.f 

l=ji _ 

\,?  "fl 


(4-41) 


As  noted  earlier,  the  ratio  of  complex  chi-squared  variables  which  enters  here  is  sub¬ 
ject  to  the  complex  F  distribution  [Equation  (A2-9)  of  Appendix  2],  and  the  required 
expectation  value  is  just  M/K.  Thus, 

m(1,M,K)  =  ^  .  (4-42) 
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from  which  we  obtain 


n 


1  +  J/K  . 


(4-43) 


and 


E«(J,M.K)  =  (1  +  J/K)!,^  .  (4-44) 

This  is  the  result  we  need  later,  and  we  note  that  the  evaluation  has  also  yielded  the 
expected  value  of  the  trace  of  the  inverse  of  a  complex  Wishart  matrix,  of  dimension 
J  and  with  J  +  K  complex  degrees  of  freedom; 

E  Tr(T‘^)  =  J/K  .  (4-45) 

It  is  worth  noting  that,  by  a  completely  analogous  argument,  the  following  result 
may  be  obtained: 

El«(J.M.K)l-'  =  ^  (4-46) 
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5.  THE  ESTIMATION  OF  SIGNAL  PARAMETERS 


We  begin  this  section  by  returning  to  the  non-adaptive  version  of  the  problem 
and  complete  the  analysis  of  its  performance,  both  in  terms  of  signal  parameter  esti¬ 
mation  and  detection  probability.  This  exercise  provides  useful  background  for  the 
adaptive  version,  and  also  ser  ves  to  introduce  some  relevant  notation.  We  recall  that 
only  the  component  Zp  of  the  data  array  enters  the  results  in  this  case,  since  the 
covariance  matrix  E  is  assumed  to  be  known. 

The  non-adaptive  signal  parameter  array  estimator,  derived  in  Section  2,  is 

bj;  =  (e^E'^e)*^  e^E'^Zp  .  (5-1) 

In  Section  3  [Equation  (3-16)],  it  was  expressed  in  terms  of  the  A  and  B  components  of 
Zp.  as  follows; 

This  estimator  is  completely  characterized  as  a  Gaussian  array,  whose  mean  and 
covariance  are 


Ebj;  =:  b 

Cov(b£)  =  (E^^)‘‘®Im  .  (5-2) 

The  first  of  these  equations,  which  states  that  the  estimator  is  unbiased,  follows  from 
Equation  (3-20).  The  second  equation  is  a  direct  analog  of  Equation  (Al-82)  of  Appen¬ 
dix  1,  since  the  estimator  has  the  form  of  a  prediction  error. 

A  whitened  estimator  may  be  defined  as  follows; 

bj:o  =  ■  (5"3) 

Its  expected  value  is 

Ebj:o  =  ^  bo  .  (5-4) 
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which  we  will  call  the  whitened  true  signal  parameter  array.  The  covariance  of  this 
whitened  estimator  is 

Cov(b£Q)  =  .  (5*5) 

and  its  pdf  is  equal  to 

^(^lo)  =  “jM 

TT 

The  components  of  the  whitened  estimator  array  are  independent,  and  all  have  vari¬ 
ance  unity. 

The  non-adaptive  decision  rule,  given  by  Equation  (3-17).  assumes  the  simple  form 
X  —  Tr(b£Qb£Q)  ^  Const  , 

in  terms  of  the  whitened  signal  parameter  estimator,  The  test  statistic  is  thus  equal 
to  the  sum  of  the  squared  magnitudes  of  the  elements  of  this  matrix.  Statistically,  X 
is  a  non-central  complex  chi-squared  random  variable,  with  JM  complex  degrees  of 
freedom,  according  to  the  usage  introduced  in  Appendix  2. 

The  "non-centrality"  parameter  of  this  distribution  is 

ao  s  'lV(bJbo)  .  (5-7) 

We  call  this  quantity  the  non-adaptive  signal-to-noise  ratio.  To  express  it  in  terms  of 
the  original  variables  of  the  problem,  we  write 

bo  bo  =  b^E'^^b  =  b”e”E'‘eb  , 
and  note  that 

eb  =  (tBtp^  =  crB(TT^)'^  . 

Then,  we  have 

bjjbo  =  B”a”E’'aB  ,  (5-8) 
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and,  finally. 


ao  =  'iy[(aBT)”  (aBr)]  .  (5-9) 

tj 

In  the  special  case  M  =  1,  tt  is  a  scalar,  the  squared  norm  of  the  t  vector.  As  noted  in 
Section  1.  this  vector  can  be  normalized  to  unity  by  a  redefinition  of  the  B  array.  If 
this  is  done,  we  will  have 

&Q  —  Dq  Dq  —  o  Q  4^  Q  D  . 

Moreover,  if  J  =  l.  then  B  itself  is  a  scalar,  and  the  signal-to-noise  ratio  reduces  to  the 
familiar  form 

ao  =  IBp  . 

In  radar  terms,  the  lest  statistic  is  a  non-coherent  integrator  of  JM  complex 
samples,  and  its  pdf  is  the  non-central  complex  chi-squared  distribution,  which  is  dis¬ 
cussed  in  Appendix  2.  The  detection  probability  is  given  by  the  Marcum  Q-function;^^ 


Po  s  Prob(A  >\o)  =  J  IjM-i(2>y^)dX  .  (5-10) 


The  corresponding  probability  of  false  alarm  is 


PFA  -  Gjj^(Xo) 


where 


m-l 

Gm(y)  =  e'y  £ 

k=0 


zi: 

k! 


(5-11) 


(5-12) 


is  the  incomplete  Gamma  function,  introduced  in  Appendix  2. 

We  return  to  the  adaptive  problem  and  recall  that  the  adaptive  parameter  array 
estimator,  found  in  Section  2.  has  the  form: 
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(5-13) 


K  -  V-I  1,, 

b  =  (e  S  e)  e  S  Zp  . 

which  is  just  like  Equation  (5-1),  with  S  replacing  E.  The  matrix  S.  of  course,  is  (L-M) 
times  the  ML  estimator  of  E,  based  on  the  Zq  component  of  the  data  array  alone,  as 
expressed  by  Equation  (2-48)  of  Section  2.  The  proportionality  constant  will  cancel  out 
in  the  above  expression  for  the  amplitude  parameter  estimator.  This  estimator  was 
later  shown  to  be  identical  to  the  array  Y.  introduced  in  Section  3  [see  Equa¬ 
tion  (3-13)].  Under  conditioning  on  the  B  components  of  the  data  array,  we  found  that 
this  array  is  Gaussian,  with  conditional  mean  and  covariance  matrices  given  by 
Equations  (3-23)  and  (3-27),  respectively: 

Efib  =  b 

CovB(b)  =  (E^^)‘^@C*  . 

We  introduce  the  whitened  estimator 

bo  s  b  ,  (5-14) 

as  in  the  non-adaptive  case.  Its  conditional  mean  is 

Eg  bo  =  bo  ,  (5-15) 

and  the  corresponding  conditional  covariance  matrix  is 

Covg(bo)  =  Ij  @  C|^  .  (5-16) 

The  bo  array  is  the  whitened  signal  parameter  array  defined  in  Equation  (5-4),  and 
the  matrix  Cj^j  (defined  in  Section  3)  is 

In  accordance  with  the  usage  begun  in  Section  4,  we  have  dropped  the  subscript  zero 
(which  indicated  whitening)  on  the  B  arrays  in  this  definition.  In  the  notation  of  Sec¬ 
tion  4,  we  have 

=  t?(N-J,M,J+K)  ,  (5-18) 
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as  noted  there.  It  will  be  recalled  that  K=L-N  — M.  The  conditional  mean  of  our 
estimator  is  independent  of  the  conditioning  variables,  hence  it  remains  an  unbiased 
estimator  (like  its  non-adaptive  counterpart)  when  the  conditioning  is  removed: 

Ebo  =  bo  .  (5-19) 

The  unconditioned  covariance  matrix  may  be  evaluated  from  the  equation 

Cov(bo)  =  Ij©(ECm)*  . 

obtained  by  taking  the  expected  value  of  both  sides  of  Equation  (5-16).  The  required 
expected  value  of  was  found  in  Section  4.  and  Equation  (4-44)  [together  with 
Equation  (5-18)  above]  yields 

Finally,  we  obtain 

Cov(bo)  =  y—  Ij®Im  (5-20) 

The  removal  of  the  conditioning  has  left  us  with  uncorrelated  columns  for  the 
parameter  array  estimator,  but  it  is  no  longer  Gaussian;  hence,  we  cannot  infer  inde¬ 
pendence,  as  in  the  non-adaptive  case.  The  relation  between  tne  covariance  matrices 
in  these  cases  is  interesting.  We  have 

Cov(bo)  =  Cov(bjo)  • 

and  the  factor  which  connects  them  is  generally  greater  thf  .i  un^Ly. 

K  +  N  ^  L-M  ^  . 

J+K  L  +  J-M-N  -  ■ 

Equality  is  attained  when  J  =  N,  as  we  should  expect,  because  in  this  special  case  the  e 
array  is  unitary,  and  definitions  (2-34)  and  (2-51)  tell  us  that  the  estimators  coincide 
in  this  case: 

J  -  N:  b  =  bj;  =  e“Zp  .  (5-21) 
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At  the  end  of  Section  3  we  introduced  a  particular  form  of  “mismatch.”  in 
which  the  signal  component  present  in  the  actual  data  differs  from  the  model  on 
which  the  GLR  detector  and  parameter  estimator  are  based.  In  this  model,  the  mean 
value  of  the  data  array  is  the  form 


EZ  =  Dt  =  dp  .  (5-22) 

where  D  and  d  are  N  x  M  arrays,  and  t  and  p  have  their  usual  meanings.  The  true 
parameter  array  now  has  a  component  which  is  in  the  subspace  defined  by  the 
signal  model,  and  a  component  bg  in  its  orthogonal  complement.  These  arrays,  origi¬ 
nally  defined  by  Equations  (3-44).  are  given  by 

b;^  =  e”  d  .  bg  s  f”  d  .  (5-23) 

In  order  to  assess  the  effects  of  this  mismatch  on  parameter  estimation,  we 
introduce  whitened  versions  of  these  signal  components,  as  follows: 

b.o* 

bfio  *  (^bb)  b[j  (5-24) 

These  definitions  are  motivated  by  Equations  (3-47)  and  (3-48)  of  Section  3.  ^ 
become 


Vo,  =  bjo  (5-25) 

and,  again  dropping  the  zero  subscript  on  Zg, 

EZg  =  bgo  .  (5-26) 

Recalling  Equations  (3-9)  and  (3-44)  of  Section  3.  together  with  Equation  (Al-8)  of 
Appendix  1,  it  can  be  seen  that 

bA-^AB^mbB  =  b^  +  (r**)'‘r*®bB  -  (E**)"’  e”E-’d  . 
hence,  we  may  writ?  the  first  of  Equations  (5-24)  in  the  form 

^AO  =  (i:^'')‘^e”E'*d  .  (5-27) 
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The  conditional  mean  of  the  whitened  parameter  array  estimator  is 

Eb^o  =  ^AO  •  (5-28) 

which  follows  directly  from  Equation  (3-46).  Since  this  result  does  not  depend  on  the 
values  of  the  conditioning  variables.  Equation  (5-28)  expresses  the  unconditioned 
mean  value  array  as  well.  The  mean  value  of  the  original  (unwhitened)  estimator 
array  is  therefore  given  by 

Eb  =  (E^^)'"^  Ebo  =  (£^^)‘‘^bAO  •  (5-29) 

Using  Equation  (5-27),  together  with  the  definition  of  we  obtain 

Eb  =  (e”E''e)'‘  e”E'‘d  .  (5-30) 

By  way  of  comparison,  we  can  evaluate  the  expected  value  of  the  non-adaptive 
parameter  array  estimator  directly  from  Equation  (5-1),  using  the  fact  that 

Zp  =  dpp”  =  d  . 

We  obtain 

Ebj  =  (e^E'^e)'^  e^E'^  EZp  =  (e“E'*e)"‘  e^E'^d  .  (5-31) 

which  expresses  the  remarkable  fact  that  the  adaptive  and  non-adaptive  parameter 
array  estimators  have  the  same  expected  values,  even  when  the  signals  are  not 
matched  to  the  model  in  our  original  formulation. 

Equation  (5-16),  which  expresses  the  conditional  covariance  of  the  parameter  esti¬ 
mator,  is  still  valid  in  ihe  presence  of  mismatch,  whose  effects  will  become  apparent 
only  when  the  conditioning  is  removed.  To  evaluate  vhe  expected  value  of  C^.  we 
recall  that  Zg  and  Wg  are  independent,  and  that  their  covariance  matrices  are 

Cov(Zg)  = 

Cov(Wg)  -  (5-32) 


Since 
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S—  VJ 

BB  "  "b”B  » 

it  follows  that  SgB  is  a  complex  Wishart  matrix,  of  order  N-J.  with  L-M  complex 
degrees  of  freedom.  Fbllowing  the  convention  established  near  the  end  of  Section  3.  it 
is  understood  that  the  covariance  matrix  of  the  underlying  Gaussian  array  of  the 
Wishart  matrix  is  the  identity.  In  the  present  case,  this  is  expressed  by  Equa¬ 
tion  (5-32).  Using  Equation  (4-45),  we  evaluate  the  mean  of  the  trace  of  its  inverse; 


etvISbJ)  = 


N-J 

L  +  J-N-M 


N-J 
J  +  K  ■ 


It  is  clear  from  the  complex  Wishart  pdf.  Equation  (A3-10)  of  Appendix  3,  that  the 
expected  value  of  any  power  of  Sgg  is  proportional  to  the  identity  matrix.  The  argu¬ 
ment  is  the  same  as  that  used  in  Section  4  to  establish  Equation  (4-38),  and  we  con¬ 
clude  that 


ESbb  -  jTk  ’n-j  • 

We  can  now  evaluate  the  required  expectation  of  both  sides  of  Equation  (5-16) 
when  mismatch  is  present.  First,  we  condition  on  Zg  in  Equation  (5-17),  and  then 
average  over  this  array,  to  obtain 

=  1m  +  JTk  ■ 


But, 


E(zKZb)  =  (EZb)“(EZb)  E(Zb  -  EZb)”(Zb  -  EZg)  .  (5-33) 

and  EZg  is  given  by  Equation  (5-26)  above.  The  second  term  on  the  right  of  Equa¬ 
tion  (5-33)  is  evaluated  as  a  special  case  of  Equation  (Al-42)  of  Appendix  1.  In  view  of 
the  covariance  matrix,  given  in  Equation  (5-32),  the  result  is 

E(Zb  -  EZb)“(Zb  -  EZb)  =  (N-J)  Im  . 

Combining  these  facts,  we  have  the  properties 
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Ebo  -  by^o 


Cov(bo)  =  Ij©[(K  +  N)Im  +  b^o^Bo]*  . 


(5-34) 


which  characterize  the  parameter  estimator  in  the  mismatched  case.  The  estimator 
attempts  to  produce  the  component  of  the  actual  signal  array  which  lies  in  the  mod¬ 
eled  subspace,  and  its  performance  is  degraded  by  the  effect  of  the  orthogonal  com¬ 
ponent  of  the  signal  array  which  increases  its  variance. 

It  is  interesting  to  note  that 


^AO^AO 


°B0  “BO 


-  (^A  '^AB^BB^B 


(b^  -  Egg  bg) 


“b  ^bb  “b 


j,AA  j,AB 

i  E®^ 

by  application  of  Equation  (Al-9).  Moreover,  we  can  write  definitions  (3-44)  in  the  form 


=  ujjd 


(5-35) 


where  Ujg  is  tne  unitary  matrix  defined  by  Equation  (8-20)  Then,  recalling  defini¬ 
tion  (3-9),  we  obtain 


'^AO^AO  ^BO^BO  "  ^  ^d  -  (tt”) 


pH  J,-1  p 


(5-36) 


la  the  matched  case  we  have  D  —  cB.  and  Equation  (5-36)  then  passes  over  into 
bgbQ,  as  expressed  by  Equation  (5-8)  above.  We  return  now  to  the  matched  problem, 
and  its  postulates  are  to  be  assumed  throughout  the  ensuing  discussion,  except  where 
the  contrary  is  explicitly  noted. 

Before  discussing  the  pdf  of  the  amplitude  parameter  estimator,  we  recall  the 
definition  of  the  general  matrix  (Equation  (4-15)]  and  introduce  the  notation  9i  for 
its  inverse; 
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(5-37) 


^(J.M.K)  =  K?(J.M.K)"'  =  + 

=  -  V”(T  +  VV“)"^  V  . 

As  in  the  definition  of  the  "6  matrices.  X.  is  often  used  as  a  ‘‘generic"  designator  for  a 
random  quantity,  not  always  a  specific  example.  In  the  above  definition,  V  is  a 
zero>mean  complex  Gaussian  array  of  dimension  J  x  M,  with  covariance 

Cov(V)  =  Ij®I„  .  (5-38) 

and  T  is  a  complex  Wishart  matrix  of  order  J,  with  J  +  K  complex  degrees  of  freedom. 
By  analogy  with  Cj^,  we  will  write 

=  ^(N-J.M,J  +  K)  .  (5-39) 

The  general  X  matrix  is  a  complex  multivariate  generalization  of  the  complex 
central  Beta  random  variable,  and  the  joint  pdf  of  its  elements  is  derived  in  Appen¬ 
dix  3.  We  use  the  notation  f0  for  the  probability  density  function  of  an  X  matrix,  and 
dQ(R)  for  the  corresponding  volume  element.  This  pdf  depends  only  on  the  dimen¬ 
sional  parameters  J.  M.  and  K,  and,  when  M=  1,  it  reduces  to  the  ordinary  scalar  com¬ 
plex  Beta  pdf  (see  Appendix  3  for  details).  The  volume  element  is  specific  to  positive- 
definite  matrices,  and  it  is  the  same  as  the  volume  element  for  the  complex  Wishart 
pdf.  Tne  notation  is  defined  in  Appendix  3.  If  4>  is  a  function  of  the  random  matrix  X, 
then  we  can  evaluate  its  expected  value  by  integrating  over  the  appropriate  pdf; 

E$[^(J,M,K)]  =  J4>(R)  fB(R,M,K  +  M,J)do(R)  .  (5-40) 


In  the  special  cases  to  be  discussed  later,  this  Beta  matrix  will  reduce  to  a  complex 
scalar  Beta  variable,  and  the  integration  will  be  a  simple,  one-dimensional  integral 
over  the  complex  (scalar)  Beta  density. 

The  X  matrices  have  some  interesting  properties,  two  of  which  will  be  established 
here  and  used  presently.  Let  be  a  unitary  matrix  of  order  M,  which  is  partitioned 
as  follows: 
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r 


We  assume  that  r  is  MjxM,  s  is  MgxM,  and  that  the  sum  of  Mj  and  Mg  is  M.  The  V 
array  is  also  partitioned,  using  L’j^: 

vuU  .  |V,  Vjl  . 

■where 

V,  =  Vr» 

Vg  s  Vs"  .  (5-41) 

The  new  components  are  complex  Gaussian  arrays  with  zero  means,  and  with 
covariances 

Cov(Vi)  = 

Cov(V2)  =  ,  (5-42) 

We  note  that 

VV"  =  VjVf  +  VgVj  ,  (5-43) 

and  consider  the  matrix 

s5t(J.M,K)s"  =  ss"  -  Vg  (T  r  VV")'*V2  .  (5-44) 

FVom  the  unitary  character  of  we  have 


G9 


Then,  using  Equation  (n-43),  we  can  write 


s«(J.M,K)s“  =  -  vJ(T  +  VjVf  +  V2V^)'‘ V2 

=  [1m2  +  V»(T  +  VjV”)-‘V2]''  . 


The  complex  Wishart  matrix  T  can  be  expressed  in  terms  of  a  zero-mean  complex 
Gaussian  array  IT: 

T  =  WW^  . 


where 


Co\{'W)  -  Ij  ®  Ij+j<  . 
It  follows  that 


T  +  VjV”  =  {W  Vj  1 

is  also  a  complex  Wishart  matrix,  of  order  J,  and  with  J  +  K  +  Mj  complex  degrees  of 
freedom.  Since  the  covariance  of  the  Vg  component  is  given  in  Equation  (5-42),  we 
have  therefore  shown  that 

sl«(J.M,K)s“  =  Jt(J,M2,K  +  Mj)  .  (5-45) 

Recall  that  s  is  Mg  M  in  dimension,  and  that  Mj  =  M  -  Mg.  In  this  equation,  as  in  others 
which  relate  generic  random  variables,  the  equality  sign  refers  to  statistical  identity, 
or  equality  of  the  corresponding  probability  density  functions. 

The  second  property  concerns  the  determinant  of  an  X.  matrix,  which  has  the 
form  of  the  inverse  of  the  GLR  test  statistic  in  the  signal-free  case,  as  discussed  in 
Section  4: 


|«(J.M,K)|  =  l/f(J.M.K)  .  (5-46) 

As  shown  in  Appendix  3,  by  a  simple  factoring  of  the  determinants, 

f(J,M,K)  =  ^(J.M2,K  +  Mi)4J.Mj,K)  .  (5-47) 
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This  is  Equation  (A3*63)  of  Appendix  3,  where  it  is  further  established  that  the  two 
factors  on  the  right  side  of  this  equation  are  statistically  independent.  The  same 
applies,  obviously,  to  their  inverses,  and  we  can  therefore  write  the  determinant  of  a 
general  %  matrix  as  a  product  of  independent  factoi-s; 

l5e(J.M.K)|  =  |.^(J,M2.K  +  Mi)|  |^(J,Mi,K)|  .  (5-48) 

We  resume  our  discussion  of  the  parameter  array  estimator,  in  its  whitened 
form,  and  define  the  estimation  error  array: 

^  =  bg  —  E  bg  ~  ^0  “  ^0  (5-49) 

We  exclude  the  special  case  J=N.  because  in  this  situation  the  adaptive  estimator 
coincides  with  the  non-adaptive  one,  as  we  have  already  noted.  There  are  no  B  com¬ 
ponents  when  J  =  N,  the  matrix  reduces  to  the  identity,  and  the  pdf  of  the  estima¬ 
tion  error  [see  Equation  (5-6)]  takes  the  simple  form 

f(()  =  (5-50) 

TT 


in  this  case. 

In  general,  the  expected  value  of  ^  is  zero,  and  its  conditional  covariance  is  given 
by  the  right  side  of  Equation  (5-16).  In  terms  of  Ry,  we  may  write  it  as 

COVg(()  =  lj®(Ry^)  , 

and  then  the  conditional  pdf  of  ^  becomes 

^((IRm)  =  (5-51) 

T 

This  form  of  the  multivariate  Gaussian  distribution  is  a  special  case  of  Equa¬ 
tion  (Al-62)  of  Appendix  1,  and  we  have  indicated  the  conditioning  variables  as  the 
components  of  Ry  itself,  since  it  is  only  through  them  that  the  B  components  sur¬ 
vive  The  unconditioned  pdf  of  ^  can  therefore  be  expressed  as  the  integral  over  the 
appropriate  density  of  Ry: 
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(5-52) 


I  |Rr’e''^^‘^«"^)fB(R;M.J-hM  +  K.N-J)do(R)  . 


This  is.  of  course,  the  pdf  of  the  whitened  parameter  estimator  array,  and  it  can 
depend  only  on  the  dimensional  parameters  of  our  model. 

It  Is  also  clear  that  f(()  depends  on  the  estimation  error  only  through  the  prod¬ 
uct  In  fact,  it  can  depend  only  on  the  non-zero  eigenvalues  of  this  matrix,  and 
these,  of  course,  are  the  squares  of  the  singular  values  of  ^  itself.  To  prove  this  asser¬ 
tion,  we  express  in  terms  of  its  eigenvalues  as  follows; 

=  U\U^  . 

where  U  is  unitary,  of  order  M,  and 

A  =  Diag[X, . X^]  . 

In  the  conditional  pdf  we  have 

Tr(RM(”()  =  TV(w”RM2iA)  . 
and.  of  course, 

IRmI  =  |w”RmZ^1  • 

u 

FVom  its  definition,  we  see  that  9L  is  statistically  indistinguishable  from  U  9tU,  since 
the  latter  is  expressible  as  an  X  matrix  in  terms  of  VU,  which  is  statistically  identical 
to  V.  Thus,  the  pdf  of  (  depends  on  (  only  through  A. 

If  signal  mismatch  is  present,  the  (  array  is  defined  by  the  equation 

^  ~  bo  —  E  Sq  =  ho  “  by^o  '  (5-53) 

so  that  it  still  has  zero  mean.  In  addition,  Rj^  is  now  a  particular  example  of  the 
non-central  generalization  of  the  X  matrix.  R^  is  the  inverse  of  C^,  defined  in  Equa¬ 
tion  (5-17),  and  the  non-centrality  arises  from  the  non-vanishing  mean  of  the  Zg 
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array,  which  is  now  given  by  Equation  (5-26).  The  effect  of  mismatch  on  the  pdf  of 
the  estimator  will  be  discussed  later,  in  connection  with  a  special  case  in  which  Ry 
reduces  to  a  non-central  complex  (scalar)  Beta  variable. 

U 

If  J  ^  M,  the  matrix  (  ^  will  have  full  rank,  except  for  a  set  of  measure  zero  in 
the  ordinary  Euclidean  sense  represented  by  the  volume  element  d(^).  Equation  (5-52) 
provides  a  convenient  starting  point  for  the  study  of  the  unconditioned  pdf  of  ^  in 
this  situation.  On  the  other  hand,  if  J<M  the  product  will  have  full  rank,  in  the 
sense  described  above,  and  an  alternative  form  of  the  conditional  pdf  of  (  can  then  be 
obtained.  This  form  will  be  more  convenient  because  it  will  involve  an  9L  matrix  of 
lower  order.  To  obtain  this  form,  we  introduce  the  array 

s  ^  ,  (5-54) 


which  has  the  familiar  properties 


s"s  = 

The  orthonormal  rows  of  s  form  a  basis  in  the  row  space  of  (.  The  orthogonal 
complement  of  this  space,  which  has  dimension  M  -  J.  is  given  a  basis  array  r  which, 
together  with  s,  forms  a  unitary  matrix; 


r 

s 


Um 


in  the  standard  way.  Expressing  ^  in  terms  of  s,  we  have 

'IV(Rm(”0  =  'IV(sRys”((")  .  (5-56) 

and  the  first  property  of  the  X  matrices,  derived  above,  may  be  applied.  In  the  pres¬ 
ent  application,  =  J  and  Mj  =  M  -  J;  therefore, 

sRys”  =  s5J(N-J.M,J  +  K)s”  =  5C(N-J.J.M  +  K)  .  (5-57) 
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Comparing  this  form  with  Equation  (5-39).  we  note  that  J  and  M  have  been  inter¬ 
changed  in  the  second  and  third  arguments  of  the  matrices  here.  We  make  the 
definitions 

Rq  s  ^(N-J.J.M  +  K) 
s  ^(N-J.M  -J.J  +  K)  . 

to  simplify  the  writing.  Thus, 

*  R. 

IRm!  -  IR„IIRjl . 

and 

f(^|R^.R^)=  (5-60) 

7T 

Since  the  factors  on  the  right  side  of  the  second  of  Equations  (5-59)  are  indepen¬ 
dent.  we  can  average  over  R^  to  obtain  a  form  of  the  pdf  which  is  conditioned  only 
on  Rj,.  Using  Equation  (4-36),  we  have 

|R^|  =  IA(N-J.M-J,J+K) 

N-J  M-J 

=  n  n  x^(j+K+j+m-i.i) . 

j-1  m«=l 

All  the  complex  Beta  variables  in  this  double  product  are  independent,  and  it  is  easily 
shown  from  the  complex  central  Beta  density  (Equation  (A2-12)]  that 

E[x>.l)f  -  . 

When  applied  to  our  problem,  we  get 


(5-58) 


(5-59) 
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N-J  M-J  1 

*  •  =  n  n 

J  =  1  IT1=1 


K  +  j- 


N-J-l 


j-|  (M  +  K+j)!(2J  +  K+j)! 


j=0 


(J+K  +  j)l(J  +  M  +  K+j)!  ■ 


(5-61) 


This  evaluation  has  given  us  the  following  expression  for  the  conditional  pdf  of 
the  estimation  error,  valid  when  the  indicated  inequality  is  satisfied: 


J<M: 

7T 


and  the  corresponding  unconditioned  pdf  of  (  is  then 


(5-62) 


f(^) 


(5-63) 


It  is  established  in  Appendix  3  (see  Equation  (A3-57)]  that 


iRi"  fB(R;M.K.j)  =  ri  , 


(5-64) 


which  holds  for  negative  values  of  n.  so  long  as  K  -  M  +  n  is  non-negative.  When  this 
identity  is  applied  to  our  example,  we  obtain 

4^  fB(R;J,J  +  M  +  K,N-J)  =  fB(R;J,2J+K,N-J)  , 

and,  consequently.  Equation  (5-63)  can  be  written  in  the  form 


tiO 


=  "TS B(R-J-2J+K.N-J)do(R) 


(5-65) 
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We  have  obtained  this  result  under  the  assumption  that  J  <  M.  However,  it  is  also 
true  when  J  =  M.  in  which  case  it  may  be  seen  that  Equations  (5-52)  and  (5-65)  differ 
only  in  the  argument  of  the  trace  operator,  which  appears  in  the  exponential  factor. 
But  when  J  and  M  are  equal,  ^  is  square  and  invertible  (except  for  a  set  of  zero  mea¬ 
sure)  in  the  sense  referred  to  earlier.  It  follows  from  Equations  (5-55)  that  the  array  s. 
now  square,  is  unitary.  We  have  already  seen  that  such  a  unitary  transformation 
may  be  applied  to  an  R  matrix  with  no  effect  on  its  statistical  properties,  and  Equa¬ 
tion  (5-56)  tells  us  that  interchanging  the  order  of  the  factors  (  and  in  the  argu¬ 
ment  of  the  trace  is  equivalent  to  subjecting  Rj^  to  such  a  unitary  transformation. 
The  determinant  of  Rj^  is  also  unaltered  by  this  unitary  transformation,  as  we  have 
observed  already.  Equation  (5-65)  is  therefore  obtained  directly,  without  the  need  to 
factor  the  R  matrix  explicitly,  and  this  completes  the  proof  of  our  assertion. 

The  analysis  which  has  led  us  to  Equations  (5-52)  and  (5-65)  made  use  of  an 
intermediate  stage  of  conditioning  (on  the  B  components  of  the  data  array)  which 
was  originally  introduced  in  Section  3.  This  method  is  parliculariy  appropriate  for  the 
analysis  of  the  GLR  test  statistic  itself.  However,  another  technique  can  be  employed 
to  obtain  a  formula  for  the  conditional  pdf  of  the  estimation  error  array.  This 
approach  leads  directly  to  Equation  (5-65),  but  without  the  restriction  on  the  relative 
values  of  J  and  M,  and  it  is  presented  here  as  an  interesting  alternative. 

We  start  from  Equation  (5-13),  as  before,  and  write  it  in  the  form 

b  =  (e^S'^e)''  e^S’^Zp  =  w”Zp  .  (5-66) 

where  w  is  a  “weight  array,"  given  by 

w  =  S'*e  (e”s'‘e)‘‘  .  (5-67) 

This  array  is  of  dimension  N  x  J,  and  it  has  the  property  that 

e"w  =  Ij 

We  recall  that 

Zp  =  Zp”  , 

and  that  the  mean  and  covariance  of  the  original  data  array  are 
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EZ  =  ebp 
Cov(Z)  =  2©Il  . 


(5-68) 


Zp  is  a  complex  Gaussian  array,  of  course,  with  mean  and  covariance  given  by 
EZp  =  eb 

Cov(Zp)  =  .  (5-69) 

I'he  covariance  has  been  evaluated  using  Equation  (Al-44)  of  Appendix  1. 

In  the  new  technique,  we  condition  on  the  array  instead  of  the  P  components, 
and  we  indicate  this  by  a  subscript  q  Since 


the  S  matrix  and  the  weight  array  w  are  fixed  under  this  conditioning.  The  form  of 
Equation  (5-66)  makes  this  a  natural  step  in  the  analysis  of  the  statistical  properties 
of  the  estimator  of  the  b  array.  Under  the  new  conditioning,  this  estimator  is  obvi¬ 
ously  a  complex  Gaussian  array,  with  conditioned  mean  and  covariance  given  by 


Eqb  -  w”EZp  *  w“eb  =  b 
Cov^(b)  Cb€)lM  . 


where 


Cjj  s  w^Ew 

=  (e“s''e)'‘  e^S'^ES'^e  (e”s'‘e)''  . 
The  conditional  pdf  of  the  estimator  array  is  therefore 
f  (u)  -  -  1  -Ty[c;‘(b-b)(b-b)”] 


(5-70) 


(5-71) 
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The  conditioning  variables  survive  only  in  the  matrix  Cjj.  whose  statistical  prop¬ 
erties  we  now  examine.  The  first  step  is  a  whitening  transformation,  in  which  we 
introduce  the  array 

(5-72) 

Like  Zq,  this  is  a  complex  Gaussian  array  with  zero  mean,  but  with  covariance  matrix 
Cov(Zq)  =  Ifj  ®1l-m  • 

We  also  introduced  the  whitened  version  of  the  S  matrix; 


So  =  ZqZq  ,  (5-73) 

which  obeys  a  complex  Wishart  distribution,  and  which,  like  S,  is  invertible  with  prob¬ 
ability  one. 

Let  Cq  be  a  whitened  version  of  the  e  array: 

eo  2  r‘^e  .  (5-74) 

This  array  is  no  longer  a  basis  array,  and  its  column  space  is  different  from  that  of 
the  original  e  (or  cr)  array.  In  terms  of  Cq.  we  have 

e”s'‘e  -  e”s'‘e 
e  o  e  -  eg  Oq  Cq  , 


and 


_  /  Ho-l  -w-l 

~  teo  Sq  Cq)  eg  Sq  Cq  (eQ  Sq  Cq) 


(5-75) 


Fbom  the  definition  of  Cq  we  make  the  evaluation 


e«eo  =  e«E-'e  ^ 


which  is  a  positive-definite  matrix  of  order  J.  We  can  establish  a  basis  array  in  the 
column  space  of  Cq  by  the  standard  procedure,  introducing  the  array 
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e,  =  ^  (5-76) 

This  development  parallels  the  introduction  of  e  itself  from  the  original  array  <7.  and 
we  obtain  the  following  identities  dii'ectly: 

-  I. 

H  .  H  vl  H 

eo  =  e,(E^^r  ■ 


Continuing  the  analogy,  we  let  fj  be  a  basis  array  in  the  orthogonal  complement 
of  the  column  space  of  Cq.  and  form  the  unitary  matrix 

Uf,  =  (  ej  fj  !  .  (5-78) 


We  use  this  matrix  to  transform  and  partition  the  Zq  array: 


= 


LH7 
ej  Zq 

^A 

0 

CSJ 

.Xbj 

the  matrix  Sq: 


•^AA  '^AB 


•^BA  -^BB 


XjXj  XsXg 


and  its  inverse: 


yAA  yAB 
yBA  yBB 


(5-79) 


(5-80) 


(5-81) 


According  to  the  third  of  Equations  (5“'’7),  we  have 
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Ho"l  _  /y>AA\i^  /oAA\V^ 

and 

/^AA\V^  /oAA\V2 

®o  Sq  Cq  =  (S  )  ej  Sq  ej  (E  y  . 

Then,  substituting  in  Eqxiatioi.  (5-75).  we  obtain 

Cb  =  Co  .  (5-82) 

where 

Co  =  (ej's'^e,)-'  efSo^e,  (efSo'e,)'*  (5-83) 

Vt'e  make  use  of  Equation  (5-81)  to  express  Co  in  terms  of  the  new  partitioned  compo¬ 
nents: 


Cq  =  (y^^y*'^  +  y''°y°'')  (y''") 

=  ij  +  (y^^)'^  y^®y®^  (y'^'^)'*  . 

In  view  of  the  identities  contained  in  Equation  (Al-8).  this  expression  is  equivalent  to 


AB  ,«BA \  /  ,«A A \- 1 


Co  -  Ij  +  -^ab  -^ba 


The  statistical  properties  of  Cq  do  not  depend  on  the  true  covariance  matrix  E.  In 
fact,  they  can  depend  only  on  the  dimensional  parameters  of  the  problem.  We  will 
oerive  these  propertie.s  shcrtly,  but  first  we  wish  to  express  the  conditional  pdf,  Equa¬ 
tion  (5-71),  in  terms  of  Cq  Prom  Equation  (5-82),  it  follows  directly  that 

ICbl  =  lCol|E''^''  .  (5-64) 


and 

Tr[c;Vb-  b)(b-  b)”]  =  Ty[Cc’vE^-^)'^(b-  b)(b-  b)”(E^^)’^]  .  (5-85) 
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But 


(j,AA)l/2(g_b)  =  ^ 

according  to  definitions  (5-4)  and  (5-14),  hence  we  can  obtain  the  conditional  pdf  of 
the  ^  array  itself.  We  can  view  Equation  (5-86)  as  a  change  of  the  variables  of  integra¬ 
tion,  and  use  Equation  (Al-66)  of  Appendix  1  to  find  the  appropriate  Jacobian; 

d(b)  =  iE^^r“d(^). 


Combining  these  results,  we  get 


fq(0  = 


1 


e-'b-(Co'<(”) 


Returning  to  the  Cq  array,  we  define 
T  .  .  XeXg  , 


(5-87) 


(5-88) 


which  is  a  complex  Wishart  matrix  of  order  N  -  J,  since  Xg  is  a  zero-mean  complex 
Gaussian  array,  whose  covariance  matrix  is  easily  found  to  be 

Cov(Xb)  =  •  (5-89) 

FV'om  this  property  it  follows  that  T  has  L-M=N+K  complex  degrees  of  freedom.  We 
also  define 


(5-90) 


which  has  dimension  J  x  (N  -  J),  and  then  we  can  write 

Cq  -  Ij  +  . 


y  is  a  function  of  the  arrays  X^  and  Xg  which  are.  of  course,  complex  Gaussian 
arrays  with  zero  means.  The  covariance  matrix  of  X^^  is 


Cov(Xy^)  -  Ij  ®  1l-m 


ai 


We  write  ?>  in  the  form 


V  =  X^Q  . 

where 

Q  =  xg 

If  we  condition  on  the  elements  of  Xg,  Q  will  be  a  constant  array  and  V  will  be  condi¬ 
tionally  Gaussian,  with  zero  mean  and  conditional  covariance  matrix 

Cove(V)  =  lj©(Q”Qr  . 

using  Equation  (Al-44)  of  Appendix  1.  The  subscript  B  is  intended  to  indicate  condi¬ 
tioning  on  Xg.  But 

Q”Q  =  =  In-J  • 


hence, 


Covgd^)  =  ,  (6-93) 

The  1}  array  has  been  shown  to  be  conditionally  Gaussian,  with  a  mean  array  and  a 
covariance  matrix  which  do  not  dep-md  on  the  conditioning  variables.  Hence,  V  has 
the  same  statistical  properties  without  the  conditioning,  and  this  is  now  removed. 

Finally,  we  replace  V  by  its  Hermitian  transpose,  making  the  definition 

V  =  .  (5-94) 


Then,  V  is  a  zero-mean  complex  Gaussian  array,  with  covariance  matrix 

Cov(V)  =  ,  (5-95) 

and  Cq  can  be  written 


^0  " 


yH  j  1 


V  . 
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This  is  clearly  a  random  matrix,  of  the  kind  defined  in  Section  4.  Its  parameters  are 
determined  from  the  definitions  of  that  section,  together  with  Equations  (5-08),  (5-89), 
and  (5-95).  Since  (N  +  K)-(N  -  J)  =  J  +  K,  we  obtain 


Co  =  ig(N-J.J.J  +  K)  . 

The  inverse  of  Cq.  which  we  call  R.^.  is  an  3t  matrix: 

=  5e(N-J,J,J-K)  . 

The  conditional  pdf  of  (  is  therefore  given  by 

fq(^)  =  f((IR^)  =  , 

7T 

and  the  unconditioned  pdf  is  therefore 

=  ~m  riR'“c-''^('^«"^fB(R;J.2J  +  K.N-J)do(R)  . 


(5-96) 


(5-97) 


(5-90) 


(5-99) 


This  is  identical  to  Equation  (5-65),  but  it  is  valid  for  all  values  of  J  and  M  which  are 
permissible  in  the  general  formulation  of  Section  1. 

Using  the  apparatus  of  Appendix  3,  it  is  possible  (when  J  :>  M)  to  integrate  out  the 
extraneous  variables  in  Equation  (5-51)  in  order  to  obtain  a  formula  for  the  condi- 

U 

tional  pdf  of  the  elements  of  (  ^  itself,  which  is  positive  definite  under  this  assump¬ 
tion.  A  similar  formula  can  be  derived  [from  Equation  (5-90)1  for  the  conditional  pdf 

LI 

of  the  elements  of  ,  which  is  positive  definite  when  To  give  expi-essio:  to 

these  conditional  densities,  we  define  the  matrices 

A  - 

A'  s  .  (5-lOj) 

The  conditional  pdf  of  A  then  assumes  the  form 

J>M:  g(A|RM)  =  (5-101) 
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and  that  of  A'  becomes 


J<M;  g(A'lR^)= 

The  associated  volume  elements  are  do(A)  and  d^vA').  respectively.  As  noted  earlier,  this 
is  the  same  volume  element  used  in  connection  with  the  Wishart  pdf.  The  normaliza¬ 
tion  factor  TpCm)  is  defined  in  Appendix  3  [Equation  (A3-8)];  it  is  a  multivariate  gen¬ 
eralization  of  the  Gamma  function.  The  unconditioned  densities  of  A  and  A'  are 
expressed  as  the  following  integrals: 


J  >M: 


J  <M: 


g(A)  = 


g(A')  = 


J  |Rr’e-'^(’^^^fB(R;M.J  +  M  +  K.N-J)do(R) 

J  fB(R;J.2J  +  K.N-J)do(R)  .  (5-103) 


To  get  explicit  results  for  the  unconditional  pdf  of  the  estimation  error  array,  we 
must  specialize  to  either  of  the  cases:  J  =  l,  M  arbitrary,  or  M=l,  J  arbitrary.  We  note 
that  the  original  parameter  array  B  has  rank  unity  in  these  situations,  and  we  antic¬ 
ipate  that  only  in  these  special  cases  will  we  find  explicit  results  for  the  probability  of 
detection. 

We  consider  the  case  M  =  1  first,  and  recall  that  J  must  be  less  than  N,  but  is  oth¬ 
erwise  arbitrary.  In  this  specialization  of  the  signal  model,  t  becomes  a  row  vector 
v/hich  distributes  the  signal  among  the  columns  of  the  data  array  Z  with  known  rel¬ 
ative  amplitudes.  If  Z  is  post-multiplied  by  «  suitable  unitary  matrix,  t  can  be  con¬ 
verted  into  a  vector  all  of  whose  components  are  zero  except  the  first  The  value  of 
this  first  component  can  then  be  factored  from  r,  and  incorporated  into  a  redefined 
B  array  The  general  problem  with  M  =  1  is  thus  equivalent  to  the  special  choice 

T  =  [1,0 . 0]  . 

In  this  model,  the  signal  is  confined  to  the  first  column  of  Z,  which  becomes  synony¬ 
mous  with  Z-,  defined  in  Section  2.  The  remaining  components  comprise  the  Z_  array. 
The  signal  itself  is  any  vector  in  a  given  J-dimensional  subspace  of  <fl  ,  and  B  is  a  col¬ 
umn  vector  of  dimension  J  These  specific  transformations  have  been  mentioned  only 
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to  illuminate  the  special  case  at  hand;  in  the  following  discussion,  we  do  not  assume 
that  they  have  been  made. 

When  M  =  l,  the  9.  matrix  of  definition  (5-37)  becomes  a  scalar.  The  relation 
expressed  by  Equation  (5-46)  is  then  simply 

je(J.l.K)  =  1/Z(J,1.K)  .  (5-104) 

We  can  therefore  make  use  of  Equation  (4-17)  of  Section  4  to  obtain  the  statistical 
character  of  Ry  in  this  case; 

Rj  =  ,X(N-J,1.J+K)  =  1/7(N-J.1.J  +  K) 

=  x^(J+K  +  l.N-J)  .  (5-105) 

The  same  result  can  be  obtained  by  specialization  of  the  complex  multivariate  Beta 
distribution,  given  by  Equation  (A3-53),  which  becomes  a  complex  scalar  Beta  variable 
as  indicated  in  Equation  (A3-54).  Fbom  Equation  (5-52)  we  now  obtain  the  uncondi¬ 
tioned  pdf  of  i  as  the  integral: 

1 

f(()  =  -j  f^(p;J  +  K  +  l.N-J)dp  .  (5-106) 

"  0 

The  complex  central  Beta  pdf  which  enters  this  formula  is  defined  in  Equation  (A2-12). 
Note  that  N-J  is  positive,  so  there  will  be  no  difficulty  at  the  upper  limit  of  this 
integral. 

H 

The  estimation  error  is  a  J  vector  in  this  case,  and  A  =  ^  ^  is  a  scalar,  the  square 
of  its  norm.  According  to  Equation  (5-106),  the  pdf  of  (  is  a  spherically  symmetric 
function  in  depending  only  on  A.  By  setting  M  =  1  in  the  first  of  Equations  (5-103), 
we  obtain  the  pdf  of  A  directly: 

1 

g(A)=  ^Jp^e-^M^(p:J+K4l,N-J)dp.  (5-107) 

0 

Alternatively,  one  can  introduce  spherical  coordinates  in  the  2J-dimensional  real  space 
corresponding  to  (C^.  and  then  integrate  out  the  angle  variables  in  Equation  (5-106). 
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The  result  is  a  function  of  radial  distance  only,  and  the  quantity  A  is  the  square  of 
this  radius.  The  procedure  just  described  is  exactly  that  to  which  the  integration  the¬ 
orem,  used  in  the  derivation  of  Equation  (5-101),  reduces  when  M  =  1.  It  is  also  the 
starting  point  for  our  inductive  proof  of  the  theorem  in  Appendix  3. 


The  integration  indicated  in  Equation  (5-107)  leads  to  a  confluent  hvpergeometric 


25 

function.  We  introduce  it  here  by  means  of  an  integral  representation;' 
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1 

J e^*  fp(p;n,m)d/D  =  jFi(n;n  +  m;x)  , 
0 


which  is  valid  when  n  and  m  are  positive  integers.  More  relevant  to  our  needs  is  the 
formula  obtained  when  the  variable  of  integration  is  changed  from  p  to  1  -  p: 

1 

'* 

e‘^  f^(p;m.n)dp  =  e‘*  jF,(n ; n  +  m ; x)  .  (5-100) 

0 


The  effect  of  the  change  of  variable  on  the  complex  Beta  density  function  is  to  inter¬ 
change  its  parameters,  an  obvious  consequence  of  its  definition.  The  process  we  have 
just  carried  out  is  equivalent  to  Kummer's  first  transformation  of  the  confluent 
hypergeornetric  function.  Equation  (A2-21)  of  Appendix  2. 

Another  property  of  the  complex  Beta  pdf  is 


fp(p;n.m) 


(n4-  m  -  l)'(n  -t-k  -l)! 
(n-l);fn  +  m  +  k-))! 


f^(p;n  +  k,m)  , 


(5-109) 


which  is  easily  verified  from  the  definition  of  this  function.  This  formula  holds  for 
negative  integral  k  as  well,  as  long  as  n  +  k  is  positive,  and  it  represents  a  special  case 
of  Eqt  ation  (5-54). 

Returning  to  integral  (5-107),  we  apply  Equation  (5-109)  to  obtain 


p*'  f^(p;J+K+l,N-J) 


(K  +  N)!(2J  +  K)! 
(J+K)!(J  +  K  J-N)! 


fp(p;2J  +  K  +  l.N-J)  . 


and  then  make  use  of  Equation  (5-108).  The  result  is 


(5-110) 


g(A)  = 


(K^N)!(2J+K)'  -A 

(J  +  K)!(J+K  +  N)!  (J-1)! 


,Fi(N-J;J  +  K  +  N  +  l;A)  . 


The  normalization  of  this  pdf  can  be  verified  by  using  the  formula 


oo 

J  x*‘e*’‘ jFj(n;n  +  m;x)dx 
0 


k!(n  +  m-l)!(m-k-2)! 
(m-l)!(n  +  m-k-2)! 


which  holds  when  m  +  k  >  2,  and  which  follows  from  results  already  obtained. 

If  the  first  argument  of  a  confluent  hypergeometric  function  is  -k,  where  k  is  a 
non-negative  integer,  then  the  function  is  expressible  as  a  polynomial  of  order  k.  The 
general  case  is  given  as  Equation  (A2-22)  of  Appendix  2.  and,  in  particular, 

iF,(0;m,x)  =  1  (5-111) 

If  we  formally  put  J  =  N  in  Equation  (5-110)  and  use  this  result,  we  obtain 


g(A)  = 


-A-.:!, 

(N-l)! 


which  is  the  correct  answer.  It  follows  directly  from  Equation  (5-50),  with  M  =  l,  when 
the  integration  theorem  of  Appendix  3  is  applied  to  convert  it  to  a  density  function 
for  A. 

When  M  =  1  and  J  is  less  than  N,  exact  results  can  be  obtained  for  the  mismatch 
problem  described  earlier.  (There  can  be  no  mismatch  problem  when  J  =  N!)  As  noted 
earlier,  the  expected  value  of  the  parameter  estimator  is  altered  by  the  mismatch.  ^ 
always  refers  to  the  difference  between  the  estimator  and  its  mean,  as  given  by 
Equation  (5-53).  The  quant  ty  b^Q  expressed  by  Equation  (5-27)  and,  in  the  present 
instance,  the  d  array  is  an  N  vector. 

We  recall  the  definition  of  C,^  and  note  that 


Cj  -  1  +  Zg  Sgg  Zg  , 
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where  Zg  is  now  a  column  vect  or,  of  dimension  N  -  J.  and  Sgg  is  a  complex  Wishart 
matrix  of  order  N  -  J,  with  L  -  M  =  K  +  N  complex  degrees  of  freedom.  We  have  noted 
the  effect  of  signal  mismatch  on  the  expected  value  of  the  parameter  array  estima¬ 
tor  and  on  the  mean  value  of  Zg,  given  by  Equations  (5-28)  and  (5-26). 

The  method  of  analysis  used  to  deal  with  the  case  M  =  1  in  Section  4  may  be 
applied  directly  to  the  study  of  Cj  and  its  inverse  Rj.  We  write  Zg  as  the  product  of  its 
norm  and  a  unit  vector,  condition  on  Zg.  and  then  make  use  of  the  property  of  com¬ 
plex  Wishart  matrices  established  in  Appendix  1.  As  a  result,  we  may  write 


N-J 

Slv.f 

^  ^bb  Zb  =  -  •  (5-112) 

j-1 

where  the  Vj  and  Wj  are  independent  circular  complex  Gaussian  variables,  all  with 
variance  unity  The  Wj  have  zero  means,  but  the  Vj.  which  are  the  components  of  Zg. 
have  non-zero  expected  values,  as  noted  above.  Thus,  the  ratio  expressed  by  for¬ 
mula  (5-112)  is  subject  to  a  complex  non-central  F  distribution,  with  non-centrality 
parameter 


c  =  (E2b)“(EZb)  =  bgobeo-  (5-113) 

It  follows  that  Rj  is  the  corresponding  complex  non-central  Beta  variable; 

Fj  =  - -  ^  —  =  x„(J  +  K  +  l.N-J|c)  .  (5-114) 

1  -t-  Zg  Sgg  Zg 

This  notation  is  defined  in  Appendix  2.  and  the  pdf  of  the  complex  non-central  Beta  is 
given  by  Equation  (A2-23).  Thus,  the  generalization  of  Equation  (5-106)  is 

1 


f(0  = 


^  Up;J+K-H,N-Jlc)dp  . 


(5-115) 


Similarly,  the  generalization  of  Equation  (5-107).  the  pdf  of  the  squared  norm  of  is 


(5-116) 


J  1  ^ 

g(A)=  Jp'’e-^N^(p;J+K  +  l.N-J|c)dp. 

0 

In  the  present  case,  we  have 


f^(p:J+K  +  l.N-J|c)  = 


-cp  ^  /J+K  +  A  (K  +  N)! 
^q\  k  )  (K  +  N+k)! 

X  f^(  p ;  J  + K  + 1 ,  N  ~  J+ k)  . 


(5-117) 


The  required  integrations  are  carried  out  by  the  same  methods  used  before.  The 
exponential  factor  which  occurs  in  the  above  formula  combines  with  those  already 
present  in  the  integrands  of  Equations  (5-115)  and  (5-116).  In  the  latter  case,  the  result 
is 


g(A)  = 


(K^N)!(2J  +  K)'  j-i  -A-c 
(J-1)!(J  +  K)! 


J+K+1 


^  /  T  1/  1  \  K 


(5-118) 


When  0  vanishes,  this  expression  reduces  to  Equation  (5-110). 

The  covariance  of  ^  in  the  general  mismatched  case  is  given  by  Equation  (5-34). 
Putting  M  =  1  in  this  expression  and  using  definition  (5-113),  we  obtain 

Cov(0=  Ij0(K  +  N  +  c).  (5-110) 

Since  A  =  (  (,  we  can  apply  Equation  (Al-42)  to  compute 

EA  =  (K  +  N  +  c).  (5-120) 

It  can  be  verified  directly  that  this  result  is  consistent  with  the  pdf  of  A,  as  expressed 
by  Equation  (5-116).  There  is,  however,  a  much  simpler  route  in  which  we  start  from 
Equation  (5-116)  and  write 
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EA  =  J  J  p^e‘^f^(p;J+K  +  l.N-J|c)dpdA  . 

0  0 

The  order  of  integration  is  now  reversed,  which  gives  us 

1 

E  A  =  J  J  fp(p;j4  K  +  1.N-J|c)dp  . 

0 


Next,  we  make  use  of  the  infinite  series  representation  for  the  non-central  com¬ 
plex  Beta  pdf.  given  by  Equation  (A2-20)  of  Appendix  2.  which  gives  us  the  form: 


EA 


J  e 


C 


p'‘f^(p;J+K  +  l.N-J+k)dp  . 


(5-121) 


Fbom  Equation  (5-109).  we  obtain 

p'^f^(p;J  +  K  +  l,N-J  +  k)  =  f^(p;J+K.N-J  +  k)  . 

and,  when  this  result  is  substituted  in  Equation  (5-121),  the  integrals  all  evaluate  to 
unity  due  to  the  normalization  of  the  Beta  densities.  The  result  is  therefore 


=  J'"  E  h 


k=0 


K  +  N  +  k 
J  +  K 


JTk  ■ 


(5-122) 


which  agrees  with  Equation  (5-120). 

The  other  special  case  mentioned  earlier  corresponds  to  J  =  1,  with  arbitrary  M.  We 
exclude  the  case  M  =  J  =  1,  which  is  covered  by  our  previous  analysis.  We  also  return  to 
the  matched  version  of  the  problem,  the  analysis  of  which  cannot  so  easily  be 
extended  to  mismatched  signals  in  this  instance. 

A  particular  example  of  the  special  case  now  under  study  is  described  by  a  <7 
array,  now  an  N  vector,  all  of  whose  components  vanish  except  the  first,  which  is 
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unity,  'liiis  form  can  be  attained  by  pre-multiplication  by  a  suitable  unitary  matrix. 
Signals  are  now  confined  to  the  first  row  of  the  data  array  Z,  whose  signal  component 
is  an  arbitrary  row  vector  in  an  M-dimensional  subspace  of  (11^:  the  row  space  of  t.  As 
before,  we  do  not  assume  that  a  transformation  to  this  special  form  has  been  carried 
out. 

The  estimation  error  is  now  a  row  vector,  of  dimension  M,  and  its  conditional  pdf 
can  be  obtained  from  Eqi’&vion  (5-98)  by  putting  J  =  1.  This  pdf  is  a  spherically  sym¬ 
metric  function  in  hvince  it  depends  only  on  the  squared  norm  of  We  could 
obtain  the  unconditioned  pdf  of  this  latter  quantity  (previously  called  A')  from  the 
second  of  Equations  (5-103)  by  integrating  over  the  conditioning  R  matrix,  which  is 
now  a  scalar  complex  Beta  variable.  However,  we  prefer  to  derive  the  unconditioned 
pdf  of  ^  itself  in  this  case,  because  of  its  relevance  to  the  adaptive  nulling  problem 
mentioned  in  S  ction  2. 

Substituting  J=1  in  Equation  (5-98),  we  observe  that  the  quantity  R.^  which 
enters  there  is  a  scalar  in  the  present  case.  Using  Equation  (5-104)  and  Equation  (4-17) 
once  again,  we  obtain  its  explicit  representation  as  a  complex  Beta  variable: 

R.y  =  .^(N-1.1,K  +  1)  =  1//(N-1.1.K  +  1) 

=  x^(K  +  2.’  1)  .  (5-123) 

The  unconditioned  pdf  of  ^  is  the  integral  of  the  conditional  pdf  over  the  density 
function  of  the  Beta  variable; 

1 

m  =  fp(p;K-r2,N-l)dp  ,  (5-124) 

0 

This  result  also  follows  directly  from  Equation  (5-99),  of  course,  when  the 
specialization  to  J  =  1  is  carried  out  [see  Equation  (A3-54)  of  Appendix  3]. 

Although  the  special  case  M  =  1  was  originally  excluded  to  assure  the  validity  of 
Equation  (5-62),  the  result  when  we  set  M  equal  to  unity  in  Equation  (5-124)  is  correct, 
as  may  be  seen  from  Equation  (5-106)  (with  J=l).  together  with  the  fact  that  ^  is  a 
scalar  in  this  case. 

The  integral  in  Equation  (5-124)  can  be  evaluated  as  another  confluent  hypergeo¬ 
metric  function,  but  it  is  much  more  useful  to  view  it  as  the  expected  value  of  a 
conditional  pdf  of  the  row  vector  (.  Under  conditioning  by  the  Beta  variable  p,  this 
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pdf  is  Gaussian,  and  the  elements  of  (  are  conditionally  independent  with  zero  means 
and  variances  equal  to  p'*.  The  pdf  of  the  wliitened  signal  parameter  estimator  itself 
is  thus  given  by 

1 

fo(bo)  =  rfo(bolp)  Vp:K  +  2.N-l)dp  .  (5-125) 

tj 

0 

where 

fo(bolP)  =  (5-126) 

If  we  make  the  definition 

ol  =  .  (5-127) 

e  E  e 

we  can  express  the  original  parameter  array  estimator  as 

^  A 

b  =  ■ 

Then,  the  joint  pdf  of  the  elements  of  this  estimator  is 
1 

f(b)  =  J  f(blp)  fp(p;K  +  2,N-l)dp  .  (5-128) 

0 

where 

f(blp)  =  .  (5-129) 

Since  J=  1,  we  can  acsunie  that  the  a  vector  is  normalized  to  unity  with  no  loss 
of  generality,  in  which  case  a  and  e  are  identical.  Moreover,  let  vs  now  consider  the 
special  form  of  the  t  array  described  by  Elquation  (1-3),  in  which  si,’nals  appear  in  the 


92 


first  M  columns  of  the  data  array  Then,  b  and  B  are  identical  [see  Equation  (2-23)]. 
and  we  have  the  same  situation  for  which  the  connection  with  adaptive  nulling  was 
first  discussed  in  Section  2.  Equations  (5-i28)  and  (5-129)  then  describe  the  joint  pdf  of 
the  M  outputs  of  an  adaptive  nulling  syst*,m  which  applies  weights  based  on  the  Zq 
array  to  the  data  vectors  which  comprise  Zp. 

The  marginal  pdf  of  the  m^^  element  of  this  output  vector  can  be  obtained  by 
integrating  out  the  other  components  under  the  integral  sign  in  Equation  (5-128).  The 
result  is  an  integral  of  the  product  of  the  same  complex  Beta  density  and  a  univari¬ 
ate  complex  Gaussian  pdf.  This  conditional  pdf  describes  a  complex  Gaussian  variable 
with  mean  value  (the  m*"^  component  of  b)  and  variance  equal  to  divided  by 
p.  A  ‘‘oonc'itional  signal-to-noise  ratio”  can  be  defined  for  this  variable,  in  the  usual 
way.  as  the  ratio  of  squared  mean  to  variance  It  is  given  by 


27 

which  repi  oduces  the  well-known  result  of  Reed.  Mallett,  and  Brennan,  in  which  the 
Beta  variable  plays  the  role  of  a  loss  factor. 

Quite  apart  from  the  detection  problem  which  has  been  the  focus  of  our  atten¬ 
tion  in  this  study,  one  can  use  these  formulas  to  analyze  the  performance  of  various 
algorithms  for  processing  the  output  sequence  of  such  an  adaptive  nulling  system. 
The  procedure  is  first  to  use  the  conditional  pdf  (which  describes  simple,  independent 
Gaussian  variables)  and  later  average  over  the  complex  Beta  pdf  according  to  Equa¬ 
tion  (5-128).  It  has  been  tacitly  assumet  that  the  adaptive  weights  based  on  the  Zq 
array  are  not  changed  as  they  are  applied  to  the  sample  vectors  of  Zp.  In  practice, 
such  weights  are  often  ‘‘frozen"  in  this  way  for  a  brief  interval  of  time,  after  which 
new  weights,  based  on  a  new  array  like  Zq,  are  found  and  applied  to  a  new  block  of 
data  vectors.  If  the  "new"  Zq  and  Zp  arrays  are  independent  of  all  the  "old”  vectors, 
then  the  new  adaptively  nulled  outputs  are  statistically  just  like  those  of  the  first 
block  and  independent  of  them.  In  our  model,  the  true  covariance  matrix  is  the  same 
for  all  the  sample  vectors  in  the  data  array,  which  now  constitutes  only  one  of  many 
such  blocks  of  data.  If  we  allow  this  covariance  matrix  (always  unknown)  to  be  differ¬ 
ent  from  block  to  block,  the  only  effect  on  the  adaptively  nulled  outputs  will  be  a 
changing  value  of  from  block  to  block.  This  extension  of  our  original  model  begins 
to  accommodate  the  non-stationarity  typical  of  situations  ordinarily  met  in  practical 
applications. 
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6.  THE  PROBABILITY  OP  DETECTION  FOR  THE  GLR  TEST 


We  proceed  now  to  a  discussion  of  the  probability  of  detection  (PD)  of  the  GLR 
test,  beginning  with  the  same  special  cases  for  which  the  pdf  of  the  amplitude  array 
estimator  was  analyzed  in  Section  5.  The  general  method  will  be  to  formulate  the 
conditional  PD.  given  the  B  components  of  the  data  array,  and  then  to  remove  the 
conditioning  by  averaging  over  these  components.  As  noted  at  the  end  of  Section  3, 
the  conditioning  variables  survive  only  through  the  matrix  C^,  which  enters  the 
"signal  component"  Vq^  of  the  V  array.  For  the  special  cases  to  be  considered  first, 
we  can  build  on  the  analysis  of  Section  4,  making  suitable  modifications  to  account 
for  the  presence  of  signals,  in  order  to  derive  the  conditional  probabilities  of  detection. 
As  we  have  already  seen,  when  J  =  N  the  matrix  reduces  to  the  identity  and  there 
are  no  conditioning  variables.  This  case  is  relatively  simple,  and  it  will  be  therefore  be 
considered  separately. 

Let  M=1  and  J  be  less  than  N.  but  otherwise  arbitrary.  In  Section  4.  the  following 
expression  was  obtained  for  the  test  statistic; 


I 


1  + 


E 

i=l 


iVj! 


K*1 

Eiwif 

j=i 


(6-1) 


The  Vj  are  the  components  of  the  original  V  array,  which  is  a  J  vector  in  this  case. 
The  argument  which  led  to  this  formula  remains  valid  when  V  contains  a  signal 
component,  but  the  numerator  of  the  fraction  here  is  now  a  non-central  complex 
chi-squared  variable  under  the  conditioning.  In  Section  3,  we  wrote  V  as  the  sum  of  a 
"signal  component"  and  a  "noise  component."  After  whitening,  this  representation 
took  the  form  of  Equation  (3-36); 


V  = 


Vo,  + 


'On 


The  subscript  zero  has  been  dropped  from  V  itself,  but  retained  on  the  components. 

The  noise  component  has  zero  mean  and,  in  the  present  special  case,  the  signal 
component  is 

Vo,  =  boC;''*  =  (6-2) 
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In  these  expressions  bg  is  the  whitened  signal  parameter  array  (a  J  vector)  and  Rj  is 
a  scalar,  given  by  Equation  (5-105).  It  follows  that 

<.Vo,  =  bJboR, 

is  the  non-centrality  parameter  of  the  complex  chi-squared  variable  in  the  numera¬ 
tor  of  Equation  (6-1).  We  write 

p  =  Rj  =  x^(J+K  +  l.N-J)  .  (6-3) 

and  also  make  the  definition 

a  =  aop  .  (6-4) 

where  is  again  the  non-adaptive  signal-to-noise  ratio  (SNR).  This  quantity  was 
expressed  in  terms  of  the  arrays  in  which  the  detection  problem  was  originally  for¬ 
mulated  by  means  of  Equation  (5-8).  which  takes  the  form 

ao  =  b“bo  =  TT”(aB)“E’'(<7B)  .  (6-5) 

in  the  present  case  Since  M=  1.  oB  is  an  N  vector,  while  tt  and  are  scalars.  The 
new  quantity  "a"  will  play  the  role  of  a  SNR  for  the  conditional  detection  problem, 
and  p  will  act  as  a  “loss  factor."  When  J  =  N,  the  same  reasc-iing  is  valicj.  except  that 
a=ao  Hence,  this  special  case  can  be  recovered  by  replacing  p  by  unity  in  the  follow¬ 
ing  analysis. 

Under  the  conditioning,  the  inverse  of  the  test  statistic  is  a  complex  Beta  vari¬ 
able.  but  now  it  is  a  non-central  one.  and  we  may  write 

\/l  =  x^(K  +  l,J|a)  (6-6) 

which  reduces  to  Equation  (4-13)  when  a  vanishes  The  conditional  detection  probabil¬ 
ity  is  a  cumulative  non-central  complex  Beta  distribution,  and  we  can  make  use  of 
Equation  (A2-26)  of  Appendix  2  to  write  it  in  the  form 
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(6-7) 


ProbB(/>/o)  =  F^(lAo;K  +  l.J|aop) 

^  /J+K 


=  1  - 


Considering  again  the  case  J  =  N.  we  see  that  Equation  (6-7),  with  p  replaced  by  unity, 
provides  the  final  detection  probability  for  the  GLR  test  in  that  specialization. 

In  general,  we  must  still  average  over  p.  which  gives  us  the  formula 


where 


PD  =  1 


(6-8) 


1 

Hk(y)  =  EGj,(yp)  =  J  Gj,(yp)  fp(p;J  +  K  f  1,N-J)dp 


(6-9) 


Substituting  for  the  incomplete  Gamma  function  (Equation  (5-12))  and  using  Equa¬ 
tion  (5-109),  we  obtain 


f^(p.J  +  K  +  l.N-J)dp 


(K  +  N)!(J  +  K  +  m)! 
(J-t-K)!(K  +  N  +  m)!  m! 


1 

% 

e'”’ fp(p,J  +  K  +  m  +  l,N-J)dp  . 

0 


(6-10) 


Fbom  Equation  (5-108),  we  obtain  the  final  result 


H^(y) 


(K^N)!  '‘y’ 

(J  +  K)' 

'  '  m=0 


(J  +  K  +  m)' 

(K  +  N  +  m)!  m!  ^  ‘ 


(N-J;K  +  N  +  m  +  l.y)  . 


(6-11) 
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Once  again,  the  formula  derived  for  J  <  N  gives  the  correct  answer  when  J  =  N.  As  can 
be  seen  from  Equation  (5-111),  the  confluent  hypergeometric  function  in  Equation  (6-11) 
is  simply  unity  in  this  case,  hence  reduces  to  Gjj. 

Equations  (6-8)  and  (6-11)  provide  a  complete  solution  for  the  probability  of  detec¬ 
tion  of  the  GLR  test  in  the  special  case  when  M  =  1.  These  formulas  depend  only  on  the 
non-adaptive  SNR,  the  detection  threshold,  and  the  dimensional  parameters  of  the 
problem.  The  threshold,  in  turn,  is  related  to  the  probability  of  false  alarm,  which  is 
given  by  the  cumulative  complex  central  Beta  distribution; 

PFA  =  F^(1Ao;K  +  1.J)  =  ^  •  (6-12) 


which  otherwise  depends  only  on  the  same  dimensional  parameters.  This  is  the  result 
previously  obtained  in  Section  4.  When  Sq  vanishes,  the  functions  of  Equation  (6-8) 
a!l  reduce  to  unity,  and  that  equation  becomes  identical  to  Equation  (6-12).  as  is  easily 
verified. 

These  equations  are  the  basis  of  the  numerical  analysis  and  results  of  Refer¬ 
ence  4,  in  which  the  performance  of  the  GLR  test  (in  this  specific  case)  is  compared 
with  that  of  a  conventional  non-adaptive  test  for  the  same  problem,  but  assuming 
that  the  covariance  is  known.  It  may  be  seen  from  Equation  (6-11)  that  the  function 
Hjj  depends  on  k  only  through  the  upper  limit  of  the  summation,  hence  these  func¬ 
tions  can  be  computed  recursively.  The  confluent  hypergeometric  functions  are  well 
behaved,  since  the  second  argument  always  exceeds  the  first  as  they  occur  in  this 
formula.  The  terms  of  their  series  are  positive,  and  they  decrease  faster  than  those  of 
exp(y).  The  error  caused  by  truncation  of  these  series  is  easily  bounded  by  the  tail  of 
the  series  for  this  exponential.  The  bound  becomes  tighter  as  one  progresses  along  in 
the  series.  Once  these  functions  are  obtained,  the  remainder  of  the  computf.Lion  of  PD, 
from  Equation  (6-8).  is  quite  straightforward. 

PVom  Equation  (6-12),  we  can  evaluate  the  derivative; 


^PFA  =  f^(lAo-K  +  l.J) 


(J+K)! 

(J-1)!K!  /‘K+l 


which  may  be  used  to  carry  out  an  iterative  solution  for  threshold  in  terms  of  PFA, 
by  the  Newton-Raphson  technique.  The  threshold  that  is  obtained  by  approximating 
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Equation  (6-12)  by  its  first  term  has  been  successfully  used  as  a  starting  point  for 
this  procedure. 

As  long  as  M  =  1,  we  can  evaluate  the  detection  performance  in  the  case  of  signal 
mismatch,  paralleling  our  discussion  of  the  estimation  error,  from  which  many  of  the 
results  we  need  can  be  obtained.  The  signal  component  of  the  V  array,  given  by  Equa¬ 
tion  (5-25).  becomes 

Vo,  =  =  b„R!^ 

in  the  present  case  Thus,  the  non-centrality  parameter  of  the  numerator  of  Equa¬ 
tion  (6-1)  is  changed  to 

»  =  =  bJob,oRi  -  bHobAoP 

The  non-adaptive  SNR  of  the  matched  case  is  now  replaced  by  the  scalar 

'^AO^AO  ~  (^A  “^AB^BB^b)  ' 

According  to  Equation  (5-27).  this  quantity  can  also  be  written 

bJobAO  =  d^E'^e  (e^E'^e)'^  e^E'^d  .  (6-13) 

The  ‘Toss  factor"  p  is  now  a  non-central  complex  Beta  variable,  given  by  Equa¬ 
tion  (5-114).  The  pdf  of  p  is  now  fp(p;J+K+l,N-Jlc).  given  explicitly  by  Equa¬ 
tion  (5-117),  and  the  appropriate  non-centrality  parameter  for  this  distribution  is 
expressed  by  Equation  (5-113): 

_  wH  V, 

^  -  '^BO^BO 

The  sum  of  these  non-centrality  pav-ameters  was  evaluated  in  Equation  (5-36). 
which  is  a  scalar  in  the  present  case.  We  define 

aj  H  tt“  D^E'^D  =  Tr[(DT)”E'HDT)]  .  (6-14) 

and  then  Equation  (5-36)  becomes 

^AO^AO  t'Bo'^BO  ~  ®i  (6-15) 
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Had  we  modeled  our  problem  differently,  so  that  signal  arrays  of  the  form  Dt  were 
expected,  then  Bj  would  play  the  role  of  the  non-adaptive  SNR.  In  fact,  it  would  be  the 
actual  non-adaptive  SNR  for  a  processor  designed  to  anticipate  such  signals.  Fbr  this 
reason,  aj  may  be  called  the  "available  SNR”  associated  with  this  signal  and  interfer¬ 
ence  environment. 

Since  the  non-centrality  parameters  are  non-negative,  we  can  make  the  defini¬ 
tions 


tJoWo  =  a,cos^e 

^BO^BO  =  c  =  ajSin^Q 


and  then  0  characterizes  the  degree  of  mismatch  in  a  simple  way.  Thus. 


a  =  Bj  cos  0  p  . 


and  the  detection  probability  becomes 


PD 


_  1  _  V  /  ajCOS-^G 


(6-16) 


(6-17) 


where 


1 

Hk(y)  =  jGk(yp)  Vp;J  +  K  +  l,N-J|c)dp 


(6-18) 


Substituting  for  the  complex  Beta  density,  we  obtain 

i.o  \  i  i(K  +  N+i)r‘^ 

1 


X  J  e*'^^  Gj,(yp)f^(p;J  +  K  +  l.N-J  +  j)dp 
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These  integrals  have  the  same  form  as  those  evaluated  before,  since  the  exponential 
factor  combines  with  a  similar  one  contained  in  the  Gj^  function.  When  these  integra¬ 
tions  are  carried  out,  and  the  order  of  summation  reversed,  we  obtain  the  generaliza¬ 
tion  of  Equation  (6-11): 


Hk(y)  = 


(K  +  N)!  -y-c  (J+K  +  m)!  y*” 
(J+K)!  ^  (K  +  N  +  m):  m! 


J+K+1 

X 

j  =  0 


E  ‘)  o\F,(N-J^i;K..N^m.>i.l;y.^o)  (6-19) 


When  c  vanishes,  or  0  =  0,  this  formula  reduces  directly  to  Equation  (6-11).  The  PFA  for 
the  mismatched  case  is.  of  course,  unchanged  and  is  given  by  Equation  (6-12). 

Numerical  evaluation  of  the  PD  from  Equation  (6-19)  presents  no  new  difficulties, 
relative  to  the  use  of  Equation  (6-11).  The  problem  of  the  detection  of  mismatched  sig¬ 
nals  using  the  GLR  decision  rule  has  been  discussed  for  the  special  case  J  =  M=1  in 
Reference  5  where  numerical  results  are  presented,  together  with  an  interpretative 
analysis  cf  the  behavior  of  this  detector.  The  parameter  0  plays  a  central  role  in  that 
analysis. 

The  other  special  case  considered  in  connection  with  the  estimation  error  is 
characterized  by  J  =  1  and  arbitrary  M.  We  exclude  the  case  J  =  N  by  requiring  N  to 
exceed  the  value  unity.  The  form  taken  by  the  test  statistic  was  found  in  Section  4. 
Equation  (4-6)  may  be  written 


I 


1  + 


M 

Eiv.f 

i=l 

K+1 

Eiw/ 


(6-20) 


which  is  analogous  to  Equation  (6-1).  The  v^  are  the  components  of  the  V  array,  which 
is  now  a  row  vector  of  M  elements.  The  denominator  here  is  a  complex  central 
chi-squared  variable,  just  as  before,  and  the  numerator  is  again  a  non-central  com¬ 
plex  chi-squared  variable  In  the  present  case,  the  (scalar)  non-centrality  parameter  of 
this  variable  is 


a  =  (EV)(EV)” 
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The  general  expression  for  the  signal  component.  Equation  (3-37),  takes  the  form 

EV  =  =  b„c;l^=  boR^.  (6-21) 

in  terms  of  the  whitened  signal  array,  which  is  also  a  row  vector  in  this  case.  Thus. 

a  =  .  (6-22) 

We  define  the  row  vector 

t  =  (bobS)-'^bo  , 

which  is  always  possible  unless  bQ  itself  is  identically  zero.  We  expressly  exclude  this 
case,  since  we  are  dealing  here  with  the  probability  of  detection  It  follows  that 

bo  =  (bobo)'’^t 

and 

tt”  1  . 


Then, 

a  =  bobg  tRj^t^  =  &Qp  ,  (6-23) 

where 

ao  =  bobj  =  Tr(bjbo)  =  (Bt)(Bt)”  (6-24) 

is  again  the  non-adaptive  SNR,  and 

p=tRMt”.  (6-25) 

Using  identity  (5-45),  applied  to  the  present  situation,  we  obtain 

p  =  t5i(N-l,M,K-l)t”  =  ^(N-l.l.K  +  M)  -  x^(K  +  M  +  l.N-l)  .  (6-26) 
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The  identification  of  ihis  one-dimensional  3t  matrix  with  a  complex  central  Beta  vari¬ 
able  is  exactly  the  same  as  in  the  study  of  the  estimation  error  in  Section  5. 

The  remainder  of  the  evaluation  is  a  direct  parallel  to  the  previous  special  case, 
but  without  mismatch.  The  test  statistic.  Equation  (6-20).  is  the  inverse  of  a 
non-central  complex  Beta  variable,  and  the  conditional  probability  of  detection  is 
given  by 


ProbB(/>^o)  ^  F^(l/^o;K  +  l.M|aop) 


=  1  - 


(6-27) 


Note  that  this  formula  is  the  same  as  Equation  (6-7),  but  with  J  and  M  interchanged 
and  K  held  constant.  Similarly,  the  probability  of  false  alarm  is  given  by 


PFA 


1 

,M+K 

‘0 


(6-28) 


This  is  formula  (4-9)  of  Section  4.  and  it  is  also  the  limiting  form  of  Equation  (6-27) 
when  the  SNR  tends  to  zero. 

The  unconditional  PD  is  therefore 


PD 


_  V  /M  +  K\.  .xk.,  /^\ 


(6-29) 


where 


Hk(y) 


1 

^kiyp)  f^(p;K  +  M  +  l,N-i)dp 

1/ 

0 


(K  +  N  +  M-1)! 
(K  +  M)! 


.-y 


k-l 

V 


m  =  0 


(K  +  M-t-m)! 

(K  +  N+M  +  m-1)!  m! 


jFi(N-l;K  +  N+M  +  m;y)  .(6-30) 
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Recalling  the  definition  of  K.  it  is  seen  that  Equation  (6-30)  lakes  a  somewhat  simpler 
form  in  terms  of  the  original  parameter  L 


Hw(y) 


(L-l)! 

(L-N)! 


.-y 


E 


m  =  0 


(L-NVm)! 
(L  +  m-1)! 


.m 


—  iFi(N-l;L+m;y)  . 


If  we  put  N  =  i  formally  in  this  expression,  and  use  Equation  (5-111)  again,  we  see  that 
the  Hjj  functions  reduce  to  the  corresponding  Gj^  functions,  and  the  PD  formula 
reverts  to  the  conditional  PD  expression,  which  we  have  seen  to  be  correct  whenever 
J  =  N. 

The  behavior  of  the  GLR  test  in  the  special  cases  just  discussed  can  be 
interpreted  in  a  simple  way  in  terms  of  familiar  radar  concepts  If  we  express  the 
decision  threshold  in  the  form 

/q  =  1  +  M  .  (6-31) 

then  for  M  =  1  (and  J  <  N)  the  decision  rule  based  on  the  test  statistic  of  Equation  (6-1) 
can  be  written  as 

J  K+l 

E  ^  M  E  •  (6-32) 

i=l  j=i 

In  this  criterion,  the  Vj  and  Wj  are  mutually  independent  complex  Gaussian  variables 
of  variance  unity.  The  Wj  have  zero  means,  and 

J 

E  1^''/  =  a  =  aoP  . 

1=1 


Equation  (6-32)  may  be  interpreted  as  the  detection  criterion  of  a  conventional 
GEAR  detector,  based  on  K  +  1  =  L-N  samples  of  "noise."  and  using  non-coherent  inte¬ 
gration  of  J  samples  of  "signal  plus  noise."  The  effective  SNR  for  this  equivalent 
detector  is  the  product  of  Bq  and  the  loss  factor  p.  which  appears  in  the  place  of  a 
more  conventional  random  target  fluctuation  variable,  as  these  fluctulation  models 
are  frequently  used  in  radar  analysis  Unlike  the  conventional  models,  our  loss  factor 
is  always  less  than  or  equal  to  unity.  Due  to  this  effect,  the  average  value  of  the 
effective  SNR  is  reduced  and  is  given  by 
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Recalling  the  definition  of  K,  it  is  seen  that  Equation  (6-30)  takes  a  somewhat  simpler 
form  in  terms  of  the  original  parameter  L 


Hk(y) 


(L-1)!  -y  Y  (L-N^m)! 
(L-N)!®  (L  +  m-1)! 


.m 


~  iFi(N-l;L  +  m;y)  . 


If  we  put  N  =  i  formally  in  this  expression,  and  use  Equation  (5-111)  again,  we  see  that 
the  Hjj  functions  reduce  to  the  corresponding  functions,  and  the  PD  formula 
reverts  to  the  conditional  PD  expression,  which  we  have  seen  to  be  correct  whenever 
J  =  N. 

The  behavior  of  the  GLR  test  in  the  special  cases  just  discussed  can  be 
interpreted  in  a  simple  way  in  terms  of  familiar  radar  concepts.  If  we  express  the 
decision  threshold  in  the  form 

^0  =  1  +  M  .  (6-31) 

then  for  M=1  (and  J<N)  the  decision  rule  based  on  the  test  statistic  of  Equation  (6-1) 
can  be  written  as 

J  K+j 

i^ii^  >  M  £  iwji^  •  (6-32) 

1=1  j=i 

In  this  criterion,  the  Vj  and  Wj  are  mutually  independent  complex  Gaussian  variables 
of  variance  unity.  The  Wj  have  zero  means,  and 

J 

2  |Ev/  =  a  =  app  . 

1=1 


Equation  (6-32)  may  be  interpreted  as  the  detection  criterion  of  a  conventional 
GEAR  detector,  based  on  K  +  1  =  L  -  N  samples  of  "noise,”  and  using  non-coherent  inte¬ 
gration  of  J  samples  of  ‘‘signal  plus  noise.”  The  effective  SNR  for  this  equivalent 
detector  is  the  product  of  Bq  and  the  loss  factor  p.  which  appears  in  the  place  of  a 
more  conventional  random  target  fluctuation  variable,  as  these  fluctutation  models 
are  frequently  used  in  radar  analysis.  Unlike  the  conventional  models,  our  loss  factor 
is  always  less  than  or  equal  to  unity.  Due  to  this  effect,  the  average  value  of  the 
effective  SNR  is  reduced  end  is  given  by 
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E  a  -  ao  E  p 


The  mean  value  of  a  complex  Beta  variable  is  easily  derived  from  the  complex  Beta 
pdf  [Equation  (A2'12)  of  Appendix  2]: 


E  x^(n.m) 


n 

n  +  m 


and  in  the  present  case,  which  is  characterized  by  Equation  (6-3).  we  obtain 


E  a  =  Bq 


N  +  K  -r  1 


L  +  J  -  N 
^0  L 


(6-33) 


There  is,  of  course,  no  loss  when  J  =  N  and  p  is  replaced  by  unity. 

Formulas  (6-7)  and  (6-12)  are  well  known  in  connection  with  the  performance  of 
conventional  CFAR  radar  detectors.  The  loss  factor  is,  of  course,  directly  associated 
with  adaptive  detection  and  its  inevitable  covariance  estimation.  It  is  easy  to  insert  a 
target  fluctuation  model,  such  as  one  of  the  Swerling  models,  into  the  analysis  at  this 
point.  The  procedure  is  to  replace  Bq  by  ubq  in  the  formula  for  the  conditional  detec¬ 
tion  probauility.  The  new  factor  u  is  a  random  variable,  independent  of  everything 
else,  and  subject  to  a  pdf  which  represents  the  desired  target  fluctuation  model.  (In 
effect,  every  element  of  the  true  signal  parameter  array  has  been  multiplied  by  the 
square  root  of  u.)  In  the  Swerling  models,  u  is  a  complex  chi-squared  variable,  and  the 
number  of  its  complex  degrees  of  freedom  can  be  related  to  J,  the  dimensionality  of 
the  signal  subspace,  so  as  to  achieve  the  desired  effect  in  the  model.  This  is  analogous 
to  choosing  the  number  of  degrees  of  freedom  in  relation  to  the  number  of  pulses 
which  are  subjected  to  non-coherent  integration  in  the  ordinary  application  of  the 
fluctuation  models 

To  compute  the  probability  of  detection  using  one  of  the  Swerling  models,  it  is 
best  to  average  first  over  the  target  fluctuation  parameter,  since  this  will  usually 
lead  to  a  simpler  formula  than  Equation  (6-7)  for  the  conditional  PD.  A  collection  of 
such  detection  formulas,  for  various  fluctuation  models,  may  be  found  in  Refer¬ 
ence  28  The  resulting  expression  is  then  averaged  over  the  complex  Beta  pdf  to 
obtain  the  final  result.  The  probability  of  false  alarm  is.  of  course,  unaffected  by  the 
addition  of  a  target  fluctuation  model. 

The  other  special  case  studied  ea.lier  can  be  interpreted  in  an  analogous  fashion, 
and  a  target  fluctuation  factor  can  be  added  to  the  model.  Our  starting  point  will  be 
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Equation  (6-20).  ■which  describes  the  performance  of  an  equivalent  GEAR  detector 
based  on  1  samples  of  "noise"  and  M  samples  of  "signal  plus  noise."  The  effective 
SNR  has  the  same  form  as  before,  namely  the  product  of  bq  and  a  loss  factor  p, 
whose  statistical  characterization  is  expressed  by  Equation  (6-26).  The  average  SNR  is 
now  given  by 


E  a 


^  K^M-H 
^  K-^M  +  N 


a© 


L^l-N 

L 


In  terms  of  L,  this  is  the  same  as  Equation  (6-33),  with  J  =  1.  Tiarget  fluctuation  can  be 
added  to  the  formulation  exactly  as  before,  and  now  the  number  of  complex  degrees 
of  freedom  of  the  variable  u  must  be  related  to  M.  In  the  special  case  described  by 
Equation  (1-3),  so  often  invoked  here  for  illustrative  purposes,  M  is  just  the  number  of 
sample  vectors  for  which  sig’ial  components  may  be  present,  and  the  correspondence 
with  ordinary  non-coherent  integration  is  quite  precise. 

In  Section  3  we  discussed  the  transition  from  the  adaptive  test  to  the 
non-adaptive  one  in  a  heuristic  way.  Now,  witn  explicit  formulas  before  us,  we  can 
sharpen  that  discussion,  at  least  for  those  special  cases  for  which  we  have  obtained 
explicit  results.  We  consider  cnly  the  f.'rst  of  the  special  cases,  namely  M=  1.  since  the 
other  can  be  obtained  by  a  trivial  interchange  of  parameters.  If  wc  put 


^  K  +  1  • 

Equation  (6-32)  becomes 


J  X  K+l 

E  Iv,p  1 E 

i=l  j=l 


I?- 


The  expected  value  of  the  right  side  of  this  equation  is  just  Ag-  variance  will 

tend  to  zero  as  K  is  allov/ed  to  increase  indefinitely  .  The  test  will  then  correspond  to  a 
non-adaptive  decision  rule  which  takes  the  form  of  non-coherent  integration  of  J 
samples  of  "signal  plus  noise  "  Making  the  same  substitution  in  liquation  (6-12),  and 
letting  K  tend  to  infinity,  we  obtain 
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which  is  the  standard  result  for  the  PFA  of  such  a  test,  and  it  agrees  with  Equa¬ 
tion  (5-11),  when  the  substitution  M  =  1  is  made. 

When  K  tends  to  infinity,  the  pdf  of  the  loss  factor  becomes  more  and  more  con¬ 
centrated  near  the  value  p  =  1  Formula  (6-9)  suggests  that  we  should  have 


Hk(y)  k'--.  Ok(y) 

in  this  case,  and  this  is  confirmed  by  an  analysis  of  Equation  (6-11)  as  K  goes  to  infin¬ 
ity.  The  detection  probability  can  thus  be  obtained  from  Equation  (6-7)  by  replacing  p 
by  unity  and  substituting  for  p.  The  result  is 


P  D  -»  1 


ao(K^l)\ 
k  +  i+Xo/  • 


Passing  to  the  limit  on  K,  the  final  result  may  be  written 

oo 

OO 

k»  J 

This  is  a  well-known  '  series  representation  for  the  Marcum  Q-function.  and  it  is  in 
agreement  with  our  earlier  result  for  the  non-adaptive  problem.  Equation  (5-10).  again 
with  M-1.  It  follows  that  the  performance  of  the  GLR  test  will  tend  to  that  of  a 
non-adaptivo  decision  rule  as  K  tends  to  infinity.  This  is  the  same  limit,  of  course,  in 
which  hV  sample  covariance  matrix  tends  to  the  true  covariance. 
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In  the  general  case,  the  f  valuation  of  the  probability  of  detection  presents  formi¬ 
dable  difficulties.  It  is  not  evaluated  explicitly  here,  but  somo  general  properties  of  the 
exact  solution  will  be  derived.  We  will  then  review  the  analysis  of  Section  4.  taking 
account  of  the  presence  of  signal  components  in  the  data.  This  exercise  will  illustrate 
the  difficulties  of  the  general  problem,  and  will  also  provide  the  basis  for  a  proof  of 
another  useful  property  of  the  exact  probability  of  detection. 

lb  deal  with  this  generalization  ef.'uctively,  some  new  notation  is  required.  As 
before,  let  T  be  a  complex  Wishart  matrix  of  order  J,  with  J+K  complex  degrees  of 
freedom.  This  matrix  can  be  expressed  in  the  form  T=WW^,  where  W  is  a  complex 
Gaussian  array  with  zero  mean.  We  also  let  V  be  a  complex  Gaussian  array  of  dimen¬ 
sion  J  X  M,  independent  of  W,  whose  mean  value  is  given  by  a  constant  array  A,  and 
whose  covariance  matrix  is  the  identity.  The  complete  set  of  definitions  is: 

EV  =  A  .  Cov(V)  =  lj©l^ 

EW  =  0  ,  Cov(W)  =  lj©lj^.K  .  (6-34) 

We  now  introduce  the  "non-central''  '€  matrix,  extending  the  notation  used  earlier. 

W(J.M.KIA)  =  1m  +  v“t*‘v  .  (6-35) 

Continuing  the  analogy,  we  define 

^(J.M.KlA)  -  15(J.M.K1A)'‘  (6-36) 

and 

f(J,M.K|A)  =  |«(J.M.K|A)|  .  (6-37) 

The  matrix  A  can  actually  be  a  function  of  different  random  quantitiv?s.  as  long 
as  these  are  completely  independent  of  the  random  variables  which  appear  in  thf 
definition  of  the  '6  matrix.  A  is  then  the  conditional  mean  value  of  V.  with  tnese 
"different”  random  quantities  held  fixed.  More  precisely,  we  can  say  that  V-A  is  a 
zero-mean  complex  Gaussian  array,  whose  covariance  is  the  identity  matrix  given 
above  for  the  covariance  of  V  itself.  This  extension  of  th  ;  significance  of  the  notation 
is  needed  in  the  discussion  of  the  GLR  test  in  the  general  case. 
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The  first  property  we  wish  to  establish  is  a  generalization  of  the  duality  between 
the  parameters  J  and  M.  observed  first  in  connection  with  the  PFA.  and  noted  again 
in  the  sbady  of  the  two  special  cases  of  the  present  section.  To  establish  this  property, 
we  assume  that  J  is  less  than  M  and  note  that  VV^  will  then  be  positive  definite 
(with  probability  one).  We  fix  the  arrays  V  and  T,  and  introduce  the  array 

5=(Vv”)''^V.  (6-38) 

The  properties 

fifi”  =  Ij 

V  =  (VV“)'^5 

follow  directly.  Now  let  5  be  a  complex  Wishart  matrix,  of  order  M.  with  M  +  K  complex 
degrees  of  freedom  Like  T.  the  new  matrix  can  be  expressed  in  terms  of  a  complex 
Gaussian  array  with  zero  mean.  According  to  the  property  established  in  Appendix  1, 
the  matrix 


is  also  complex  Wishart,  of  or<  .  J,  and  with  J  +  K  complex  degrees  of  freedom.  It  is 
statistically  identical  to  T.  hence  we  can  write. 

|lM  +  v”T■^';  =  lly  f  v“5y'*<s“v|  . 

The  factors  in  this  determinant  may  be  permuted  cyclically,  as  shown  in  Appendix  1, 
so  that 


i^  +  v“t‘‘v!  =  iij  +  5y'^<s“vv“i 


=  llj  +  (Vv’’')^<S5'‘5”(VV”)'^i  =  llj  +  V5'‘V 


-I  wH, 


Finally,  if  we  define 

1>  =  v”  , 


(6-39) 
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we  obtain  the  form: 


1Im  +  v”t''v|  =  |lj  +  y”57‘’vi  . 

where  now  V  is  M  x  J  and  3  is  of  order  M. 

This  is  the  desired  duality  property,  and  it  may  be  expressed  by  the  relation 

^(J.M.KIA)  =  /(M,J.K|a")  .  (6-40) 

As  in  other  similar  situations,  the  equality  here  refers  to  statistical  identity,  or  equal¬ 
ity  of  the  corresponding  distribution  functions.  The  form  of  the  result  itself  shows 
that  it  is  valid  regardless  of  the  relationship  between  J  and  M.  The  symmetry  between 
J  and  M  will  be  lost  when  this  identity  is  applied  lo  the  conditional  detection  prob¬ 
ability  and  the  conditioning  is  subsequently  removed,  as  we  have  seen  in  the  two  spe¬ 
cial  cases  already  worked  out. 

The  non-central  "6  matrices  exhibit  another  feature,  which  will  lead  us  to  a  useful 
general  property  of  the  unconditioned  probability  of  detection  Let  Uj  and  be 
arbitrary  unitary  matrices,  whose  orders  are  indicated  by  their  subscripts,  and  let 

V  .  uJvuS 

T  •  uJtUj  ,  (8-41) 


It  follows  that 


|i,^  +  v”t‘‘v!  =  |ly  +  V”f Vj  , 


(6-42) 


and  also  that 

E  V  =  uJ  A  Ui5  E  A  .  (6-43) 

The  unitary  transformation  has  no  effect  on  the  statistical  character  of  the  T  matrix, 
and  the  transformed  V  array  is  still  complex  Gaussian,  with  the  same  covariance 
matrix  as  V  itself.  Only  its  mean  value  is  changed,  according  to  Equation  (6-43).  This 
yields  another  statistical  equivalence,  expressed  by  the  relation 

^(J.M.KIA)  =  /(J.M.KIA)  ,  (6-44) 


no 


We  now  introduce  the  singular  value  decomposition  of  the  A  array,  writing 

A=UjAoUm.  (6-45) 

where  Uj  and  Uy  are  unitary  matrices  of  orders  J  and  M,  respectively,  and  Aq  is  a 
diagonal  array.  The  diagonal  elements  of  Aq  are  the  singular  values  of  A.  ordered  in 
an  arbitrary  way.  If  we  identify  Uj  and  with  the  unitary  matrices  of  Elqua- 
tions  (6-41),  we  see  that 

f(J.M.K|A)  =  f(J.M.KlAo)  .  (6-46) 

in  the  sense  of  statistical  equivalence.  Thus,  the  probability  distribution  function  of 
the  random  variable /(J.M.Kl A)  depends  only  on  the  singular  values  of  the  A  array. 
It  is.  in  fact,  a  symmetric  function  of  these  numbers,  since  they  may  be  permuted 
arbitrarily  by  a  transformation  of  the  kind  described  by  Ekjuations  (6-41).  The  singular 
values  of  A  are.  in  turn,  the  non-negative  square  roots  of  the  eigenvalues  of  AA".  (If 
J  >  M,  this  matrix  will  be  rank-deficient,  and  it  will  have  J  -  M  zero  eigenvalues,  in 
addition  to  the  squares  of  the  singular  values  of  A.)  In  any  case,  we  can  say  that  the 
statistical  properties  of  /(J,M,K|A)  depend  only  on  these  eigenvalues.  In  particular, 
we  can  write 

Prob  (/(J.M.KIA)  >/o]=  ♦(.f.M.Ki/o  ; Aa“)  .  (6-47) 

where  ♦(J.M.K.x.X)  is  a  real-valued  function  of  the  scalar  parameters  J,  M,  K,  and 
X,  and  of  the  square  J  x  J  matrix  X  depends  only  on  the  eigenvalues  of  X.  hence  it  is 
unaffected  if  X  undergoes  a  similarity  transformation: 

X  -  Uj  X  uJ*  . 

Now  let  us  apply  these  results  to  the  GLR  test  statistic,  by  identifying  A  with  the 
signal  component  of  the  V  array,  Vq,.  first  defined  in  Equation  (3-37).  Then  we  will 
have 


A  =  =  b„Rif  . 

where  Uq  is  the  whitened  true  signal  amplitude  parameter  array,  and  is  statisti¬ 
cally  described  in  Equation  (5-39)  as  a  central  %  matrix; 
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Rm  =  5?{N-J.M.J+K)  . 


which  is  completely  independent  of  Vqj,  =  V-A  and  T.  With  this  substitution  for  A. 
Equation  (6-47)  expresses  the  conditional  probability  of  detection  of  the  GLR  test.  The 
unconditioned  PD  is  obtained,  formally,  by  averaging  over  the  X  matrix: 


PD 


j4(J,M.K:/o;boRbJ)  fB(R;M.J+M  +  K.N-J)do(R)  . 


(6-48) 


where  fg  is  the  pdf  of  the  multivariate  Beta  matrix.  This  integral  is  an  example  of  a 
general  type  discussed  in  Appendix  3  [see  Equation  (A3-52)]. 

We  now  introduce  the  singular  value  decomposition  of  bQt 

^0  “  '  (6-49) 

where  Uj  and  u^  are  unitary,  and  ^  is  a  diagonal  JxM  array,  whose  diagonal  ele¬ 
ments  are  the  singular  values  of  bQ  In  terms  of  /9.  we  have 

boRbJ  =  Uj^UmRuK^^u?  . 

We  can  now  make  a  change  of  variables  in  the  integral,  defining  the  new  matrix 

R'  s  R  uJJ  .  (6-50) 

The  Jacobian  of  this  transformation  is  unity  [it  is  a  special  case  of  Equation  (A3-14)  of 
Appendix  3],  and  it  also  leaves  the  pdf  of  the  matrix  R  unchanged,  a  fact  we  used 
repeatedly  in  Section  5.  Finally,  the  function  4  is  unaffected  by  the  application  of  the 
similarity  transformation  described  by  Uj.  and  we  conclude  that 


PD 


4(J.M,K;/o;^R/?”)  fB(R;M.J+M  +  K.N-J)do(R)  . 


1/ 


(6-51) 
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This  shows  that  the  final  probability  of  detection  depends  only  on  the  singular  values 
of  bQ.  the  whitened  signal  parameter  array.  The  bp  array  depends,  in  turn,  on  the 
true  covariance  matrix  and  the  true  signal  parameter  array  b  (or  the  original 
array  B).  The  singular  values  of  bo  are  the  non-negative  square  roots  of  the  eigen¬ 
values  of  the  matrix  bobQ,  which  we  have  encountered  already  in  Equation  (5*8)  of 
Section  5.  We  may  call  it  the  “signal-to-noise-ralio  matrix,"  and  we  recall  that  the 
non-adaptive  SNR  is  its  trace.  According  to  Equation  (5-8),  the  SNR  matrix  depends  on 
T  only  through  the  product  tt^,  and  it  is  therefore  unchanged  if  t  is  post-multiplied 
by  any  unitary  matrix  of  order  L  This  fact  confirms  the  invariance  property  of  the 
GLR  detection  probability  already  observed  at  the  end  of  Section  2,  In  the  two  special 
cases  for  which  we  have  obtained  complete  performance  results,  the  SNR  matrix  has 
rank  unity.  The  extension  of  our  results  to  cases  for  which  this  matrix  has  higher 
rank  remains  an  interesting  challenge. 

In  Section  4  we  derived  a  formula  which  expresses  the  tes*  statistic  as  a  product 
of  two  factors  which  proved  to  be  statistically  independent  of  one  another.  This  fac¬ 
torization  was  then  iterated,  to  obtain  a  double-product  representation  which  pro¬ 
vides  the  basis  for  the  evaluation  of  the  PFA  in  the  general  case.  When  signal  compo¬ 
nents  are  present,  the  factorization  is  still  valid,  but  the  factors  are  no  longer 
independent,  and  the  conditional  detection  probability  (conditioned  on  R^j)  cannot  be 
obtained  by  the  methods  used  for  the  evaluation  of  the  PFA.  The  factorization  is  use¬ 
ful,  however,  for  the  proof  of  a  monolonicily  property  of  the  exact  solution  which  will 
now  be  derived. 

Following  closely  the  analysis  of  Section  4.  we  introduce  a  subspace  of  the  vector 
space  by  separating  all  column  vectors  into  two  components  of  dimension  Jj  and 
J2.  where  Jj  +  Jg  ~  J.  We  write 


Ai 

A  s 

W  E 

Tsl 

A2 

W3) 

(6-52) 


which  extends  Equations  (4*20)  to  include  the  mean  value  array  A,  introduced  in 
Equation  (6-34).  Components  of  the  T  matrix  and  its  inverse  are  introduced,  using 
definitions  (4-21)  and  (4-22).  and  then  Equations  (4-23)  and  (4-24)  are  still  valid.  We 
can  write 


+  =  t?(J2.M.Ji  +  K|A2)  . 


(6-53) 
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applying  our  new  notation  to  the  problem,  and  this  equation  replaces  Equation  (4-20) 
as  a  statement  of  the  statistical  character  of  the  quantity  on  the  left  side.  As  before, 
we  put 


^  ^  (Vi-TiaTjiVgXl^  +  vjTa^Vg)-'^  .  (6-54) 

and 

3  =  (t”)‘‘  .  (6-55) 

and  then  we  have 

/(J.M.KIA)  =  !1m^v”t''v1=  +  +  .  (6-56) 

If  we  condition  on  the  2-components,  and  recall  that  we  are  dealing  with  whit¬ 
ened  quantities  in  the  present  case,  we  can  compute 

E2  V  =  =  Aj  (1^  ^  V”  T22^  V2)*'^  .  (6-57) 

U 

since  Tj2  =  WjW2.  and  Wj  has  zero  mean  Stretching  the  notation  slightly,  we  can 
express  the  statistical  character  of  the  left  side  of  Equation  (6-56)  by  writing 

/(J.M.KlA)  =  /(Ji.M.K|wrfi)^(J2.M.Ji  +  K|A2)  -  (6-58) 

Because  jrfj  depends  on  the  2-components  of  V  and  W.  the  factors  in  this  expression 
are  not  independent,  and  this  fact  is  the  main  impediment  to  the  derivation  of  an 
explicit  formula  for  the  conditional  probability  of  detection.  Of  course,  if  we  had  such 
an  expression,  we  would  then  be  faced  with  the  evaluation  of  the  integral  in  Equa¬ 
tion  (6-48)! 

To  obtain  the  monotonicity  property  referred  to  above,  we  specialize  our  factori¬ 
zation  to  the  case  Jj  =  l,  so  that  Aj  becomes  a  row  vector  of  M  components.  Condi¬ 
tioned  on  the  2-components,  is  fixed,  and  we  can  write 

Prob2(/(l.M.KMi)  >  m]  =  4>(1.M.K;m;G)  .  (6-50) 

where  /z  is  a  constant,  and  G  is  given  by 
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G  ^  =  AidM  +  V^TaaVg)'*  Af  . 


(6-60) 


When  J|  =  1.  we  have 

/(l.M.Kl^i)  =  l/x^(K  +  l.M|G)  .  (6-61) 

which  is  a  direct  generalization  of  Equation  (4-18)  of  Section  4.  The  extension  to  a 
non-central  Beta  variable  made  here  is  very  much  like  the  extension  discussed  in 
detail  in  Section  5,  in  connection  with  the  mismatched  signal  problem.  Reference  may 
be  made  to  Equations  (5-112)  and  (5-114)  for  details  of  that  discussion.  Finally,  using 
the  notation  of  Appendix  2,  we  can  write 

«J>(1.M.K;m;G)  =  Fp(l//.i;K  +  l.M|G)  .  (6-62) 

Fhom  the  explicit  form  of  the  cumulative  complex  non-central  Beta  distribution, 
given  by  Equation  (A2-27)  of  Appendix  2.  it  may  be  seen  that  the  right  side  of  Equa¬ 
tion  (6-62)  is  an  increasing  function  of  G  (we  will  use  the  term  “increasing”  here  as 
shorthand  for  "monotone  non-decreasing”). 

Now  we  let 


f(J2.M,J,  +  KlA2) 


(6-63) 


which  makes  /i  a  function  of  the  2-components  Then,  in  view  of  Equation  (6-58),  we 
can  express  the  right  side  of  Equation  (6-47)  in  the  form  of  an  expectation  value  over 
the  2-component  variables  implicit  in  fu.  and  G: 

<i>(J,M,K;fo:AA”)  =  E4>(Ji,M,K;m;G)  .  (6-64) 

We  have  seen  that  this  probability  depends  only  on  the  singular  values  of  A.  We  can 
therefore  assume  that  A  is  already  in  diagonal  form,  since  this  can  be  accomplished 
by  the  transformation  indicated  in  Equation  (6-45).  Now  suppose  the  two  unitary 
matrices  which  appear  in  that  equation  are  fixed,  and  that  one  of  the  singular  values 
is  allowed  to  vary,  all  the  others  being  held  constant  Since  the  order  of  the  singular 
values  was,  m  any  case,  immaterial,  we  can  take  the  variable  one  to  be  the  first  entry 
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in  the  diagonal  form  of  A.  When  we  apply  the  factorization  described  above,  with  Jj  =  1, 
the  row  vector  Aj  will  then  have  all  zero  entries  except  the  first,  which  we  may  call 


A,  =  [a,  0.  .0] 

Then  G.  defined  by  Equation  (6-60).  will  take  the  form 

G  =  (aj)^  [10...0](1m  +  V«T2JV2)-‘  [10.. .01“ 

This  matrix  product  is  necessarily  positive;  hence,  the  left  side  of  Equation  (6-62)  is  an 
increasing  function  of  aj.  This  property  is  preserved  when  the  expectation  indicated  in 
Equation  (6-64)  is  carried  out.  We  have  therefore  shown  that  the  left  side  of  that 
equation  is  an  increasing  function  of  aj  which  was  an  arbitrary  singular  value  of  A. 

Let  A  and  B  be  two  J  x  M  arrays  which  have  identical  singular  values  except  for 
one.  say  a  and  b.  Then,  if  a^  b.  we  will  have 

<J>(J.M.K./o:Aa”)  <  <l>(J.M.K;fo:BB”)  .  (6-65) 

since  A  and  B  can  be  put  into  diagonal  form,  with  a  and  b  as  the  first  entries  in  the 
respective  diagonals,  and  the  result  proved  above  can  then  be  applied.  More  generally, 
let  the  ordered  singular  values  of  A  and  B  be  related  as  follows; 

aj  <  b,  ,  1  <  i  <  Min(J  .M)  .  (6-66) 

Then,  Equation  (6-65)  is  again  correct  since  the  singular  values  can  be  increased  one 
by  one.  changing  from  the  A  values  to  those  of  B,  and  the  corresponding  probability  is 
always  increasing.  Inequality  (6*66)  defines  an  ordering  of  J  x  M  arrays,  and.  in  terms 
of  this  ordering,  the  probability  function  on  the  left  side  of  Equation  (6-65)  is  an 
increasing  function  of  the  A  array. 

Let  bp  and  bjj  be  two  whitened  signal  parameter  arrays,  and  suppose  that 


bo  <  bo  .  (6-67) 

in  the  sense  of  the  ordering  defined  above.  Let  the  singular  value  decompositions  of 
these  arrays  be  given  by  the  equations 

bo  ~  ^  -  bo  =  Uj7  . 
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and  let  us  assume  that  in  both  cases  the  singular  values  are  ordered,  say  from  the 
largest  to  the  least.  Then,  according  to  the  ordering  of  the  arrays,  we  have 

/Sj  <  7i  .  1  <  i  <  Min(J.M)  . 

FVom  our  previous  discussion,  it  follows  that  we  can  replace  the  original  signal 
parameter  arrays  by  the  diagonal  arrays  ^  and  y  in  the  expressions  for  the  uncondi¬ 
tioned  probability  of  detection  for  these  two  cases.  This  probability  is  given  by  Equa¬ 
tion  (6-51)  for  bQ.  and  by  the  same  formula  (with  y  replacing  for  the  other  case. 
The  two  probabilities  are  therefore  expressible  as  integrals  of  appropriate  conditional 
probabilities  over  the  same  complex  multivariate  Beta  distribution. 

The  conditional  probabilities  depend,  in  turn,  on  the  eigenvalues  of  the  matrices 
and  7R7^.  Let  v  stand  for  the  smaller  of  the  parameters  J  and  M.  Then,  the  v 
largest  eigenvalues  of  these  J  x  J  matrices  coincide  with  the  i/  largest  eigenvalues  of 
the  respective  M  x  M  matrices.  X  and  Y,  which  are  defined  by  the  equations 

X  =  .  Y  =  R'^7“7R’^  . 

If  i/  =  J.  then  the  eigenvalues  of  these  new  matrices  will  be  augmented  by  one  or  more 
zero  vahies  The  difference 

Y-X  =  R'^(7“7  -  ^“/S)R‘^ 

is  clearly  a  non-negative  definite  matrix.  In  Appendix  1.  by  an  application  of  the  Cou- 
rant-Fisher  theorem,  it  is  shown  that  the  ordered  eigenvalues  of  X  are  less  than  or 
equal  to  their  counterparts  in  the  list  of  ordered  eigenvalues  of  Y.  We  may  conclude 
that  the  ordered  eigenvalues  of  ^R^  are  less  than  or  equal  to  their  counterparts  in 
the  list  of  ordered  eigenvalues  of  7R7^.  Fhom  this  relation  it  follows  that  the  uncon¬ 
ditioned  probability  of  detection  for  the  signal  parameter  array  bp  is  less  than  or 
equal  to  that  corresponding  to  the  other  parameter  array  bj^-  Thus,  the  probability  of 
detection  is  an  increasing  function  of  the  singular  values  of  the  whitened  signal 
parameter  array,  or,  equivalently,  of  the  eigenvalues  of  the  SNR  matrix  b^bg.  and  this 
is  the  monotonicity  property  we  set  out  to  establish. 
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7.  A  GENERALIZATION  OF  THE  MODEL 


In  Section  1  we  mentioned  a  generalization  of  the  basic  model  of  the  hypothesis 
testing  problem.  The  null  hypothesis,  which  previously  corresponded  to  the  complete 
absence  of  signal  components,  is  replaced  by  the  hypothesis  that  a  particular  compo¬ 
nent  of  the  signal  parameter  array  is  zero,  the  rest  being  arbitrary.  More  precisely, 
this  model  takes  the  form 

Hq :  oBy  =  0 

Hj  :  B  is  arbitrary  .  (T"l) 

The  fixed  arrays  a  (rxj)  and  y  (Mxt)  determine  the  component  of  the  B  array  whose 
presence  or  absence  constitutes  the  purpose  of  the  test.  We  postulate  that  the  rank  of 
a  is  r<  J.  while  that  of  y  is  t<  M,  and  anticipate  that  these  arrays  will  determine  sub- 
spaces  in  (S  and  (C  ,  respectively 

The  significance  of  the  model  is  illustrated  by  the  specific  example 

«  =  I  0  1,  1 


J  M 

in  which  a  and  y  provide  direct  decompositions  of  (fl  and  (tt  .  In  accordance  with 
these  decompositions,  we  may  partition  B  as  follows: 


B  = 


Bii  Bj2 

B21  B22 


Then,  the  test  becomes  a  decision  on  whether  or  not  832  is  zero,  while  the  other  three 
components  of  B  may  have  any  values  on  either  hypothesis  These  latter  components 
may  be  considered  to  describe  "nuisance  signals,"  while  832  describes  the  "desired 
signal"  component  which  may  be  present  in  the  data  array 

To  specialize  further,  suppose  that  both  Equations  (1-3)  and  (1-4)  hold,  so  that  the 
signal  structure  itself  corresponds  to  the  "canonical  form”  discussed  in  Section  1.  As 
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shown  by  Equation  {1-8),  the  signal  components  are  then  confined  to  the  upper  left 
corner  of  the  data  array,  and  the  first  M  - 1  of  these  columns  contain  only  nuisance 
signals.  The  remaining  t  columns  which  are  allowed  to  contain  signals  are  further 
divided  into  two  subspaces  (corresponding  to  Bjg  and  Bgg).  of  which  one  contains 
desired  signals  and  the  other  only  more  nuisance  components. 

The  task  of  the  decision  rule  in  the  general  case  is  to  detect  the  desired  signals  in 
the  presence  of  the  others,  against  a  background  of  unknown  noise  and  interference. 
A  GLR  test  will  now  be  derived  which  accomplishes  this  goal  ana  which  turns  out  to 
have  very  similar  structure  to  the  test  studied  in  the  earlier  sections  of  this  study.  In 
particular,  this  test  will  have  the  same  extended  CFAR  property  as  the  former  one, 
and,  in  addition,  its  performance  will  not  be  influenced  by  the  presence  of  nuisance 
signal  components. 

We  begin  by  expressing  the  null  hypothesis  in  terms  of  the  “normalized"  signal 
parameter  array  b,  defined  in  Equation  (2-23),  writing 

aBy  =  abc  ,  (?-2) 


where 


a  =  a  (a^y  )*'^ 

c  H  (tt")-^7  .  (7-3) 

lb  set  up  the  subspace  projections,  we  introduce  the  basis  arrays 

a2  s  (aa^)‘'^a 

C2  s  cfc^c)'*^  (7-4) 

in  the  usual  way,  and  note  that  the  null  hypothesis  now  corresponds  to  the  condition 
agbcg  =  0  (7-5) 

The  relations 
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a  =  (aa^)'‘^a2 
c“c  -  I 

CgCg  - 

C  =  03(0^0  )‘^ 


follow  directly,  and  we  work  with  ag  and  from  here  on.  instead  of  with  a  and  c. 

The  row  space  of  83  is  an  r*dimensional  subspace  of  and  we  introduce  an 
orthonormal  basis  aj  for  its  complementary  subspace.  (This  nomenclature,  which  uses 
the  subscript  2  for  the  subspaces  representing  desired  signals,  is  arbitrary,  but  proves 
convenient  in  the  later  analysis.)  Similarly,  let  Cj  be  an  array  of  basis  vectors  in  the 
space  complementary  to  tue  column  space  of  Cg,  so  that 


a"  - 
- 

Ij-r 

H 

Ij 

- 

Cm  — 

•m-1 

+  C2C2  = 

Im- 

Finally  we  introduce  unitary  matrices 


Uj  - 


Um  =  I  Cl  C2 1 


in  analogy  to  the  matrices 


U 


N 


e 


which  we  will  also  need. 


(7-6) 
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As  before,  the  data  array  is  first  decomposed  using 

zu"  =  IZp  zj  . 


where 


Z„  -  Zp^ 


Zo  -  zq 


(7-7) 


The  Zp  component  is  further  decomposed  by  means  of 

Zp^M  =  (Zpi  2p2|  , 


where 


Zpi  -  Z  P"  Cl 


Z_2  =  Z  p  Co  • 


(7-8) 


Together,  a  threefold  decomposition  of  is  produced,  based  on  the  unitary  matrix 


Um  0 


=  cjp 


(7-9) 


When  applied  to  the  data  array,  this  decomposition  gives  us  the  equation 


zC!!  -  Izpi  Zp2  \ 


(7-10) 


In  a  similar  way,  Uj  and  U,,;  are  combined  »o  form  a  threefold  decomposition  of 


Ufi  Us- 


uy  0 


'1  c?  f  . 


(7-11) 
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where 


ej  s  eaj^ 

62  s  eaj  .  (7-12) 

The  derivation  of  the  GLR  test  begins,  as  in  Section  2.  with  the  maximization  of 
the  probability  density  functions  over  the  unknown  covariance  matrix.  The  test  sta¬ 
tistic  can  then  be  expressed  in  the  form 

Min  I  F(b)  1 

,  .  Jlo _  , 

Min  I  F(b)l 
H, 

where  F(b)  is  still  given  by 

F(b)  =  (Z  -  ebp)(2  -  ebp)”  , 


Under  Hj  the  array  b  is  unconstrained,  while  under  Hq  it  is  subject  to  the  linear  con¬ 
straint  (7-5)  We  begin  with  the  null  hypothesis  and  introduce  some  notation  in  order 
to  accommodate  the  constraint,  Consider  the  matrix  product 


UjbU^ 


ajbcj  aibc2 
fl2bCj 


<5,  p 
f>Z  0 


(7-13) 


by  which  /S,  6^,  and  are  defined.  The  zero  component  is  the  result  of  the  constraint, 
as  expressed  by  Equation  (7-5)  We  use  the  new  parameters  to  express  b  in  the  form 


b  = 


0 


Ujj  s  (5c“  +  afflc”  . 


where 


6  E 


(7-14) 
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and.  of  course. 


0 


U 


H 

J 


The  (J-r)xt  array  /S  is  the  analog  of  Bjg  in  the  special  exanriple  described  above, 
while  6,  which  is  of  dimension  J  x  (M  -  t).  represents  the  components  analogous  to  both 
Bjj  and  Bgj.  The  minimization  required  under  Hq  is  the  same  as  an  unconstrained 
minimization  over  <5  and  p. 

To  bring  the  new  arrays  into  play,  we  separate  F(b)  into  terms  corresponding  to 
the  decomposition  of  by  writing 

F(b)  =  (Z  -  ebp)  Ul  C'l  (Z  -  ebp)” 

=  (Zpi  -  ebCj)(Zpi  -  ebcj)”  +  (Zp2  -  ebc2)(Zp2  -  ebc2)^  +  S  . 


where,  as  in  Section  2. 

S  =  ZqZ”  . 

Using  the  representation  (7-14),  we  have 

bcj  -  6 

bC2  =  a[^/3  ,  (7-15) 

and,  therefore. 


F(b)  =  (Zp,  -  e<5)(Zpi  -  e6)”  +  (Zpg  -  ei^)(Zp2  -  e,^)”  +  S  .  (7-16) 

We  make  the  definition 

S(/?)  ^  (Zp2  -  ei^)(Zp2  -  +  S  (7-17) 

and  proceed  to  carry  out  the  minimization  over  5.  This  follows  precisely  the  proce¬ 
dure  of  Section  2.  with  a  result  analogous  to  Equation  (2-41): 
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Min|F(b)|  =  !S(/3)||Im.i  +  z“  P  Zpjl  . 


(7-18) 


where 


P  s  $■'  -  S'’e(e”s'’e)'*  e“  S'*  .  (7-19) 

This  quantity  appears  to  depend  upon  /?,  but  it  is  actually  independent  of  that  array; 
hence,  the  right  side  of  Equation  (7-18)  will  depend  on  /S  only  through  the  first  of  the 
two  factors.  In  analogy  to  Equation  (3-12),  only  the  component 

f”pf  =  (f”s  f)'^ 


is  non-vanishing,  and  the  evaluation 


f”sf  =  f”(Zp2Zj2  +  S)f 


shows  the  claimed  independence  of  It  follows  that 

Min|F(b)l  =  Hm-i  +  ZpiPZpi!  Min|S(^)|  . 

Hq  ^ 

The  minimization  over  p  is  the  same  problem  over  again,  and  we  can  immedi¬ 
ately  write 


Min|S(^)i  =  |S||1,  +  zJgOZpgl  . 

0 

where  n  is  defined  by 

n  =  S‘^  -  S'‘ei(e[^S‘‘ei)’‘  e“s'‘  ,  (7-20) 

Combining  our  results,  we  obtain 

MinlF(b)|=  |S|ilM.,+  z”PZp,l|li+  zJgOZpgl.  (7-21) 

Ho 
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The  minimization  of  F(b)  under  Hj  has.  of  course,  been  carried  o*.;,  in  Section  2. 
but  it  is  useful  to  derive  the  result  again,  in  a  slightly  different  v  'h  parallels 

the  analysis  just  given  Specifically,  we  represent  b  in  terms  of  tv  ays,  as  fol¬ 

lows: 


b  =  6'cf  +  ^'c”  (7-22) 

These  arrays  are  unconstrained,  and  their  role  is  to  allow  the  minimization  to  be  car¬ 
ried  out  in  two  steps,  as  was  done  under  Hq.  The  new  expression  for  F(b)  is  the  same 
as  Equation  (7-16).  but  with  the  array  e^  replaced  by  e  itself.  The  final  result  is  then 

Min|F(b)l  =  ISiH^.i  +  z“iPZp,l!li  +  zJgPZpgl  . 

where  P  is  the  same  array  which  appeared  in  Section  2; 

P  =  S‘'  -  S‘’t(e”s'‘e)''  e”s’'  (7-23) 

The  two  versions  of  the  minimization  under  Hj  yield  the  equation 

Hm  -  zJPZpl  =  ll«-l  *  P  Zpll  III  ZpzPV  •  <^-2“) 

which  can  also  be  verified  directly  as  an  identity  involving  determinants. 

The  GLR  test  statistic  now  assumes  the  form 


\\  ^  z^^nZp^i 

Hi  ^  ZpzPZpzl  ’ 


(7-25) 


which  corresponds  to  Equation  (2-42).  We  note  that  the  component  Zpj  has  dropped 
out  of  the  test  completely  In  the  case  of  the  special  example  described  at  the  begin¬ 
ning  of  this  section,  the  first  M  - 1  columns  of  the  data  array  would  be  discarded  in 
forming  the  GLR  test  statistic  The  remaining  data  array  components.  2p2  and  Zq,  are 
partitioned  as  follows; 
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(7-26) 


Wn' 

TjH  7  =: 

^p2  - 

Za 

fjh  7  = 

Wa 

.  Zfi  . 

The  subscript  N  refers  to  the  "nuisance”  components,  while  the  A  and  B  portions  are 
directly  analogous  to  the  corresponding  components  employed  in  Section  3.  In  analogy 
to  Equation  (3-5),  the  S  matrix  is  also  expressed  in  component  form: 


uU  s  0^. 


'NN 

^NA 

%B 

'AN 

Saa 

^AB 

'BN 

^BA 

SfiB 

(7-27) 


By  repeating  the  analysis  of  Section  3,  using  appropriate  partitionings  of  this  S 
matrix,  we  obtain  the  evaluations 

'■^p2  P  ^p2  “  ^B 

and 


nz 


^AA  ^AB 

-1 

Za‘ 

.  ^BA  ^BB 

.Zb. 

Again,  using  Equation  (Al-9)  of  Appendix  1,  we  have 

zJsRZpg  =  -  zSSb‘Zb  , 

where  Y  and  T  are  given  by 

^  ~  ^AB  ^BB  -^'B 

-  ^AA  ~  ^AB  ^BB  ^BA 


(7-28) 


(7-29) 
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Substituting  these  results,  we  find  that 


I  =  lu  zSsbbZb  ^  y”t~W| 

Hi  ^  Z^Sb^ZbI 

By  introducing  the  definitions 

~  ■*'  Zg  Sgg  Zg 

V  E  Y  C"'^  .  (7-30) 

we  obtain  the  final  result 

^  =  |]^  +  v”t'‘ V'l  .  (7-31) 

all  in  direct  correspondence  with  the  analysis  of  the  original  model  of  the  hypothesis 
testing  problem  We  note  that  the  components  and  Wjj  have  also  dropped  out  of 
the  test,  so  that  in  the  special  example  mentioned  earlier,  the  first  J  -  r  rows  of  the 
data  array  would  also  be  discarded 

The  performance  of  the  GLR  test  in  the  more  general  context  of  the  present  sec¬ 
tion  is  exactly  the  same  as  in  the  original  problem,  when  the  appropriate  parameter 
correspondences  are  made.  To  establish  these  correspondences,  we  retrace  the  steps 
through  the  various  transformations  which  have  been  made,  evaluating  their  statis¬ 
tical  consequences.  The  quantities  B  (or  b)  and  S  now  represent  the  actual  values  of 
these  arrays,  hence  the  expected  value  of  the  original  data  array  is 

EZ  =  ebp  . 

Recalling  the  definition  (7-9),  we  have 
EZUl  =  eb  1  Cj  Cg  0  1  . 

and,  therefore,  in  view  of  Equation  (7-10),  the  component  Z^  has  zero  mean,  while 

EZpg  =  ebcg  (7-32) 

Similarly,  from  the  original  covariance  property 
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Cov(Z)  =  E®1l 

and  Equation  (Al-42)  of  Appendix  1.  we  obtain  the  results 

Cov(Zp2)  =  E®Ii 
Cov(Zq)  =  ■ 

In  addition,  the  components  and  Zp2  are  independent. 

The  components  and  Wg  obviously  have  zero  mean,  and  from  definitions  (7-11) 
and  (7-12),  together  with  Equation  (7-32),  we  obtain 


EU»2p2  = 


bCr 


and,  consequently, 

EZa  =  a2bc2 
EZb  =  0  . 


The  only  component  of  the  actual  signal  parameter  array  which  can  have  any  effect 
on  the  GLR  test  is  agbcg,  which  is  just  the  component  whose  presence  is  being  tested. 
The  fact  that  nuisance  signals  enter  into  the  hypotheses  has  the  consequence  that,  in 
general,  only  a  portion  of  any  signal  of  the  original  postulated  form  ctBt  will  contrib¬ 
ute  to  the  decision  to  accept  Hj 

In  analogy  to  Equation  (7-27),  we  introduce  the  components  of  the  transformed 
true  covariance  array: 


E  =  UL^EUk-  = 


^NN 

2na 

^NB 

^AN 

^AA 

CD 

< 

.  ^BN 

^BA 

^BB 

(7-33) 


It  follows  that 
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cov(0!;zp2)  =  Sell 

Cov(0!lz,)  .  gsI^.H 

If  we  introduce  the  notations 


Za 

III 

< 

Wa 

CO 

1 

1 

for  the  surviving  components  of  Zpg  and  Z^.  we  can  write 


1 

EW^  = 

0 

0 

*  c 

0 

and 


Cov(Z^)  = 


^AA  ^AB 
^BA  ^BB 


Cov(W^) 


^AA  ^AB 
. ^BA  ^BB 


Next,  we  define  the  components  of  the  inverse  matrix: 


> 

> 

Zab 

-1 

j,AA 

j,AB 

Z^BA 

^BB, 

< 

m 

(7-34) 


to  complete  the  parallel  with  the  original  problem.  Note  that  the  components  defined 
on  the  right  side  of  Equation  (7-34)  are  not  partitions  of  the  inverse  of  the  full  T, 
matrix. 

Finally,  a  whitened  array  is  defined; 

Vo  H  =  Vo3  +  Vo„  .  (7-35) 

in  which  the  "signal  component"  is  given  by 
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Vos  =  . 


(7-36) 


Note  that  the  dimension  of  Vq  is  rxt.  The  whitened  T  array  in  the  present  case  obeys 
a  complex  Wishart  distribution  of  dimension  r  (and  with  L  +  J  -  N  -  M  complex  degrees 
of  freedom)  as  it  did  in  the  original  problem. 

The  rest  of  the  analysis  is  identical  to  that  of  Section  3.  whose  results  apply 
directly  to  the  present  case  with  the  replacements 

b  -*  agbcg 

J  -•  r 

M  -  t 

L  L  T”  t  ~  M 

N  -«  N  +  r  -  J  .  (7-37) 

With  these  correspondences,  the  results  obtained  in  Sections  4,  5,  and  6  are  also 
directly  applicable. 
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APPENDIX  1 

MATHEMATICAL  BACKGROUND 


Several  groups  of  related  mathematical  results,  most  of  them  well  known,  are 
collected  here  for  reference;  they  are  used  freely  in  the  text. 


A.  LEMMAS  INVOLVING  PARTITIONED  MATRICES 


Partitioned  matrices  occur  frequently  in  the  analysis,  and  we  begin  with  a  deri¬ 
vation  of  some  indispensible  identities.  If  A  and  D  are  square  non-singular  matrices, 
where  A  is  of  order  K  and  B  is  of  order  L,  then  the  partitioned  array  whose  blocks  are 
A,  B,  C,  and  D  can  be  factored  in  two  ways,  as  follows. 


A 

B 

Ik 

0 

A 

0  ■ 

Ik  a''b1 

C 

D 

,CA'‘ 

II 

.0 

D-CA' 

*B. 

,  0 

II  1 

Ik 

BD‘^ 

A- 

-BD'‘C 

0 

0  1 

0 

II 

0 

D 

Id''c  II  ) 

(Al-l) 


As  a  direct  consequence,  we  obtain  the  useful  determinant  identity 

^  ®  !  =  |A|  |D-CA‘'b|  =  |D|  lA-BD'^Cl  . 

C  D  I 

The  special  case 

|I  +  BCi  =  |i  +  cb; 


(Al-2) 


(Al-3) 


is  frequently  applied  in  the  text. 

By  inverting  the  factors  in  Equation  (Al-l).  which  is  a  straightforward  process, 
and  then  multiplying  out  the  results,  we  obtain  the  standard  inversion  formulas 
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A 

B 

-1 

C 

D 

A‘'  + A'‘B(D-CA''Br*CA“' 
-(d-ca‘'b)'^ca‘‘ 


-A*^B(D-CA'‘B)'' 

(d-ca'‘b)'‘ 


(a-bd''c)‘‘ 


-(a~bd‘‘c)'‘bd'’ 

-D'^C(A-BD''C)'‘  D"'  +  D‘‘c(A-BD'^C)'^BD‘‘ 


(Al-4) 


Rirther,  by  comparing  these  expressions,  we  obtain  the  generalized  Woodbury  for¬ 
mula 


(A-BD'‘c)''  -  A'^-r  A'’b(D-CA'*B)  ^CA'’  . 


(Al-5) 


Another  useful  identity  may  be  obtained,  using  the  first  of  Equations  (Al-1),  as  follows: 


U  V 


A  B 

X 

Y 

=  (U +VCA'^)A(X +A‘’bY)  +  V(D-CA‘'b)Y 


(Al-6) 


We  often  use  the  notation 


Mu  Mi2 

M21  M22 


(Al-7) 


as  a  convenient  way  of  identifying  the  blocks  of  a  partitioned  matrix  and  its  inverse. 
By  applying  Equation  (Al-4)  to  M  and  also  to  its  inverse,  we  obtain  the  relations 


m"  =  (M,i-Mi2M2'iM2,y' 

MiV  = 

MjV  Mi2  =  (Al-8) 

and  so  on.  A  special  case  of  Equation  (Al-6)  is  frequently  encountered: 
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u 

V 


=  (U-MiaMggV)”  m’^(U-Mj2M22V)  +  V^MggV  .  (Al-9) 


(u”  v”] 


in  which  we  have  also  made  use  of  some  of  the  relations  expressed  in  Equation  (Al-8). 

B.  MATRIX  LEMMAS  INVOLVING  EIGENVALUES 

Suppose  the  product  AB...YZ  of  some  number  of  arrays  is  square,  although 
some  or  all  of  the  factors  may  be  rectangular.  Then  ZAB...Y  is  also  square,  and  gen¬ 
erally  of  a  different  order  than  the  original  matrix,  as  is  every  other  product  formed 
by  cyclic  permutation.  Suppose  vhe  original  product  has  a  non-zero  eigenvalue  X. 
There  will  then  be  a  normalized  eigenvector  V'  which  satisfies  the  eigenvalue  equation 

AB...YZV'  =  XV'  . 

Since  Xip  is  not  zero,  the  vector  cannot  vanish. 

Multiplying  on  the  left  by  Z,  we  obtain 

ZAB...YZV'  =  \ZTp  , 

which  shows  that  X  is  also  an  eigenvalue  of  ZAB...Y.  Thus,  X  is  an  eigenvalue  of 
every  cyclic  permutation  of  the  original  product.  Many  (perhaps  all)  of  these  products 
will  be  rank-deficient,  with  null  eigenvalues  supplementing  the  shared  non-vanishing 
ones.  We  may  ^ay  that  these  products  are  "eigenvalue-equivalent”  matrices,  since 
every  non-vai  .ohing  eigenvalue  of  one  of  them  is  an  eigenvalue  of  every  other. 

The  sum  of  all  the  non-zero  eigenvalues  of  each  of  these  products  is  the  same, 
which  is  consistent  with  the  equality  of  their  traces.  If  we  add  the  appropriate  iden¬ 
tity  matrix  to  each  cyclic  product  and  form  the  determinants  of  the  resulting  sums, 
then  all  these  determinants  will  be  equal,  a  fact  which  also  follows  from  Equa¬ 
tion  (Al-3). 

We  consider  the  maximization  problem  posed  in  Section  2.  We  are  given  a  pair  of 
positive-definite  matrices  Aj  and  A2.  of  order  N,  and  we  are  to  evaluate 

I  Ai  o 

y  ^  Max  — —  -  .  (Al-10) 

°  !a"A2o| 
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the  maximization  being  carried  out  over  all  full-rank  arrays  a  of  dimension  N  x  J.  We 
introduce  the  positive-definite  square  root  of  Ap  and  define 


i  =  (7  . 


(Al-11) 


Then. 


y  =  Max 


ju^Bui 


(Al-12) 


the  maximization  being  over  all  NxJ  arrays  u.  of  rank  J,  where 


W  =  A2  Aj  A2 


(Al-13) 


The  matri::  u”u  is  positive  definite,  as  a  result  of  our  rank  as.sumption;  hence,  we 
can  introduce  the  array 


/  H  v-l/2 
fj.  =  u  (u  u; 


(Al-14) 


which  satisfies  the  relation 


n  I 
At  M  =  Ij 


15) 


Since 


we  have 


u  - 


lu^Bul 


lu”u| 


Thus. 


y  =  Max  l/i^B^i  . 


(Al-16) 


subject  to  the  validity  of  Equation  (Al-15),  nov/  viewed  as  a  constraint. 
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If  the  eigenvalues  of  the  positive-definite  matrix  B  are  called  Xj^,  placed  in 
decreasing  (or  non-increasing)  order  from  Xj  through  X^j.  then 

y  =  Xi-  .  (Al-17) 

as  will  be  proved  below.  By  the  cyclic  permutation  lemma,  the  Xj^  are  also  the  eigen¬ 
values  of  Aj(A2)*\  and  this  is  the  property  which  was  used  in  Section  2. 

To  prove  the  assertion  made  above,  let  the  eigenvectors  of  B  be  V'n-  properly 
orthogonalized  in  case  of  the  degeneracy  of  any  of  the  eigenvalues,  and  also  normal¬ 
ized.  If  we  take  for  ^j.  the  array  whose  columns  are  the  first  J  of  these  eittenvectors. 
the  constraint  will  automatically  be  satisfied  and  the  result  claimed  for  the 
maximum  will  be  attained. 

Now  suppose  that  fu.  is  an  array  which  satisfies  Equation  (Al-15),  and  such  that 

>  X,...Xj  .  (Al-18) 


We  define 


M  s  .  (Al-19) 

and  note  that  M  is  a  positive-definite  matrix  of  order  J.  Let  its  ordered  eigenvalues  be 
and  let  Uj  be  a  unitary  matrix  which  diagonalizes  M,  placing  the  eigenvalues  in 
decreasing  order,  according  to 

U»MUj  =  Diagf^i . Mj]  . 

or 

u  Bv  Diag[Aii . Mj]  . 

where 

1/  £  ■  (Al-20) 

Then, 


IMi 


Hn  , 
V  Bu\ 


Ml-.  A^j  >  X,  ...Xj  . 


(Al-21) 
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Since  the  fx's  and  the  X's  are  positive  and  similarly  ordered,  we  must  have 


(Al-22) 


for  at  least  one  value  of  k  between  unity  and  J.  Fixing  this  value  of  k,  we  form  an 
array  77,  of  dimension  N  x  k,  which  consists  of  the  first  k  columns  of  u.  Then, 


ri^Uri  =  Diag[Mi,...,Mk]  • 


(Al-23) 


and,  since  Uj  is  unitary. 


VV  =  Iv  • 


(Al-24) 


Let  S  be  the  subspace  of  (fi  for  which  the  columns  of  tj  form  a  basis,  and  let  0  be 
an  arbitrary  vector  in  S.  Then, 


x(0)  s 


0”M0 

0»a 


k 

I 

m=s  1 


Eie.l 

m*  I 


(Al-25) 


where  the  0^^  are  the  coefficients  of  0  in  the  basis  defined  by  77; 
k 

®  =  E  • 

m=l 


Equation  (Al-25)  follows  directly  from  the  properties  of  77,  as  expressed  by  Equa¬ 
tions  (Al-23)  and  (Al-24).  trom  Equation  (Al-25).  we  conclude  that 

Min  x(0)  =  Mk  >  •  (Al-26) 

e 

because  the  fj.^  are  positive  and  in  decreasing  order.  But  Equation  (Al-26)  contradicts 
the  Courant-Fisher  theorem,^®  according  to  which 
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(Al-27) 


Max  Min 
s  ecs 


e”M0 

e”© 


=  Mk  • 


the  maximization  being  carried  out  over  all  subspaces  of  dimension  k,  and  this  com¬ 
pletes  the  proof. 

In  Section  6  of  the  text,  another  relationship  between  eigenvalues  was  used  which 
is  a  direct  consequence  of  the  Courant-Fisher  theorem  itself.  Suppose  that  A  and  B 
are  Hermitian  matrices,  of  order  N.  and  that  the  difference  B  -  A  is  non-negative  defi¬ 
nite.  We  can  write  A<B  to  indicate  the  ordering  of  these  matrices.  If  the  ordered 
eigenvalues  of  A  and  B  are  aj^  and  bj^,  respectively,  then  it  follows  that  aj^  5  bj^  for  all 
k  from  1  to  N. 

To  prove  this  claim,  we  let  w  be  any  N  vector  and  observe  that 
w^Aw  <  w^B  w  , 


This  inequality  is  fully  equivalent  to  the  statement  that  B-A  is  non-negative  definite. 
If  Sjj  is  any  k-dimensional  subspace  of  then  we  can  certainly  say  that 

w  w^Aw  ^  w^Bw 

Min  — —  <  Min  — r —  • 
wes^  w”w  wcS,,  w”w 

But.  according  to  the  Courant-Fisher  theorem,  we  have 

Min  <  Max  Min  ^  =  bj^  . 

weS„  w"w  wcS^  w"w 


where  the  Max  is  taken  over  all  k-dimensional  subspaces  of  (C  .  Thus, 


Min  ^  S  , 
wcSk  w”w 


and  the  desired  result  follows  immediately; 


w^Aw 


ai.  =  Max  Min  — r; —  <  b 


(Al-28) 


wcSj,  W'W 
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C.  THE  KRONBCKBR  PRODUCT 


In  the  main  text,  ve  dealt  with  collections  of  random  variables  which  are 
arranged  as  rectangular  arrays.  Such  a  collection  may  also  be  viewed  as  a  vector,  by 
mapping  the  pair  of  indices  of  the  array  into  a  single  index  in  some  definite  way.  The 
covariance  matrix  of  a  rectangular  array  of  random  variables  will  be  an  array  which 
is  characterized  by  a  pair  of  double  indices,  and  the  use  of  this  mapping  will  allow  us 
to  establish  a  consistent  notation  for  such  matrices  and  their  products  with  vectors. 

Let  Z  be  an  array  with  components  Z;  „  and  let  the  single  index  a  correspond  to 
the  pair  fi.j),  according  to  some  one-to-one  mapping  such  as  lexigraphical  ordering. 
Then,  the  Z  array  can  be  written  as  a  vector,  as  follows: 

=  Z|j  .  a  (i.j)  .  (Al-29) 

We  use  a  lowercase  symbol  to  indicate  the  vector  which  corresponds  to  an  array 
identified  by  the  same  letter  in  uppercase  The  inner  product  of  a  pair  of  such  vectors 
can  then  be  expressed  in  terms  of  the  original  arrays,  according  to  the  evaluation 

x"y  =  I]  x;  y„  =  X’jYi  j  -  TVCx”  Y)  .  (Al-30) 

a  i.j 

The  notation  is  extended  in  a  natural  way  to  matrices  whose  rows  and  columns  are 
each  designated  by  index  pairs.  An  element  of  such  a  matrix  may  be  written  in  the 
form  A(j  j),  or,  equivalently,  as 


where 


a  >  (i.j)  .  P  <— >  (k,l)  . 

A  general  bilinear  form  in  this  notation  is  evaluated  as  follov's; 

x^ay  =  ^  x^a^^y^  ~  12  hi  ^i.)  ^(i,j);(k,i)  ^k,i  (Al-31) 

a.p  i.j  k.l 


If  the  elements  of  such  an  array  can  be  expressed  as  products  of  the  elements  of 
two  other  arrays,  indexed  in  the  ordinary  way.  according  to  the  rule 
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(Al-32) 


^(i.j);(k.l)  "  ^i,k  ^j,l  ■ 

then  A  is  called  the  Kronecker  product  of  B  and  C,  and  we  write 

A  =  B®C  .  (Al-33) 

If  B  is  JxK  and  C  is  Mx  N,  then  A  is  JM  x  KN  in  dimension.  The  algebraic  properties  of 
the  Kronecker  product,  as  an  operator,  follow  easily  from  its  definition.  In  particular, 
we  note  that 


(B®C)”  =  b“®c“ 

Tr(B®C)  =  Tr(B)Tr(C) 

(Bi®Cj)(B2®C2)  =  (BiB2)®(CiC2)  .  (Al-34) 

and,  if  B  and  C  are  square  and  non-singular, 

(B®C)'^  =  .  (Al-35) 

If  the  square  matrices  B  and  C  are  of  orders  J  and  M,  respectively,  then  the  Kronecker 
product  is  square  and  of  order  JM.  Its  determinant  is  given  by 

|B®C|  =  iBi^lCl''  .  (Al-36) 

Finally,  if  A  has  the  form  of  Equation  (Al-33),  the  general  bilinear  form 
[Equation  (Al-31)]  becomes 

x”ay  =  Tr(x”BYC''')  .  (Al-37) 

and,  as  a  special  case,  we  obtain  the  multiplication  rule 

(ay)„  =  (BYC'^),  j  .  a  (i.j)  .  (Al-38) 
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D.  RANDOM  ARRAYS 


Consider  a  complex  random  array  Z.  of  dimension  J  x  M.  For  simplicity  of  writing, 
we  assume  that  the  mean  value  of  Z  is  zero,  since  we  are  interested  primarily  in  its 
covariance  properties  here.  Since  Z  is  a  doubly  indexed  set  of  random  variables,  its 
covariance  matrix  is  automatically  of  the  doubly  indexed  type,  and  we  make  the  def¬ 
inition. 


[Cov(Z)](j ®  EZjjZjji  (Al-39) 

If  this  covariance  has  the  form 

“  ®i.k  ^j.i  •  (Al-40) 

then  we  have 

Cov(Z)  =  B®C*  .  (Al-41) 

In  this  case.  B  is  square  and  of  order  J,  while  C  (also  square)  will  be  of  order  M.  The 
paradigm  for  this  choice  of  ordering  of  the  indices  is  the  array  Zj  j  =  b^Cj,  where  b  and 
c  are  independent  random  vectors  whose  covariance  matrices  are  B  and  C,  respec¬ 
tively,  The  full  covariance  matrix  is,  of  course,  Hermitian,  and  it  can  always  be 
arranged  that  the  factors  B  and  C  are  individually  Hermitian.  Then,  the  identities 

EZZ”  =  .BTrC 

Ez”z=CTrB  (Al-42) 

follow  directly  from  the  definition.  More  generally,  if  X  and  Y  are  complex  random 
arrays  whose  means  are  zero  and  whose  elements  satisfy  the  equation 


then  we  write 

Cov(X,Y)  =  D®E*  . 


(Al-43) 
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Now  suppose  that  U  and  V  are  fixed  arrays,  and  that  the  product 


2'  =  UZV 

makes  sense  dimensionally.  If  the  covariance  of  Z  satisfies  Equation  (Al-41),  it  follows 
that 


Cov(Z  )  =  (UBU”)©(V”CV)’  .  (Al-44) 

More  generally,  if  X  and  Y  satisfy  Equation  (Al*43)  and  if 

X'  =  U,XV, 

Y'  =  UyYVy  . 

where  U^,  L’y,  and  are  fixed  arrays,  then  we  have 

Cov(X'.Y')  =  (U^DUj!)@(vJjEVy)*  .  (Al-45) 

B.  COMPLEX  GAUSSIAN  VECTORS 

In  the  above  discussion,  and  also  throughout  the  main  text,  we  encounter  collec¬ 
tions  of  complex  random  variables.  In  order  to  fix  our  ideas  and  our  notation  about 
such  collections,  especially  about  arrays  of  Gaussian  random  variables,  we  review  here 
some  of  the  basic  facts  concerning  them,  beginning  with  complex  Gaussian  vectors. 
Lei  z  be  a  column  vector  of  dimension  J.  whose  elements  are  complex  Gaussian  ran- 
,1.  *1  variables  with  zero  means.  Then,  the  joint  probability  density  function  of  z  takes 
the  general  form 


f(z)  =  ,  (Al-46) 

tT-'iri 

where  F  is  a  complex  positive-definite  matrix.  With  the  definition  +  iyjj  for 

each  of  the  elements  of  z,  the  volume  element  associated  with  this  pdf  is  written 

d(z)  =  dxj...dxjdyj...dyj  .  (Al-47) 
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The  statistical  significance  of  definition  (Al-46)  will  follow  from  its  expression  in  terms 
of  the  real  component  random  variables  themselves.  To  derive  this  form,  we  consider 
the  one-to-one  correspondence  between  z  and  the  real  vector  u,  of  dimension  2J, 
defined  by 


2  =  K . Zjf  >  u  =  [xi.....Xj.yj . yjf 

Let  ♦  be  a  complex  matrix,  of  order  J.  and  let 

z'  =  ♦z  .  (Al-48) 

Then,  if  the  real  vector  covresponding  to  z'  is  called  u'.  a  linear  relationship 

u'  =  Fu  (Al-49) 

will  hold  for  a  suitable  real  rnfitrix  F.  We  separate  4  into  real  and  imaginary  parts, 
making  the  definition 

+  ilii  .  (Al-50) 

where  4>p  and  'tj  are  real  matrices  ci  order  J.  Then,  applying  our  definitions,  we  find 
that  F  is  expressible  in  block  iorm,  as  follows; 


(Al-51) 


This  equation  establishes  a  mapping  between  complex  matrices  of  a  given  order 
and  real  matrices  of  twice  that  order.  Under  this  mapping,  the  product  corre¬ 
sponds  to  FgFj,  the  inverse  correponds  to  F’^  and  so  on.  If  9  is  Hermitian,  then  F 
is  symmetric,  since  4'^  is  symmetric  and  4»j  is  skew-symmetric  in  this  case.  It  is  also 
easily  verified  that 


z^tz  =  u'^Fu  . 


(Al-52) 


Obviously,  each  vector  z  has  the  same  quadratic  norm  as  its  real  counterpart  u. 
Finally,  by  elementary  row  and  column  operations,  we  evaluate  the  determinant 
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♦r 

♦r -*■»*!  -♦l  +  i*R 

♦r  . 

*^1  *R 

4>fj  +  i<l>l  0 

<!>,  -  i<t, 


(Al-53) 


If  Equation  (Al-48)  is  viewed  as  a  linear  transformation  of  variables,  applied  to  a  mul¬ 
tiple  integral  over  the  volume  element  of  Equation  (Al-47).  then  Equation  (Al-53)  pro¬ 
vides  an  evaluation  of  its  Jacobian. 

Returning  to  the  Gaussian  pdf.  we  put  P  =  Fr  +  iPj  and  make  the  definition 


at  -  i 


(Al-54) 


Thus,  r  is  associated  with  2M.,  according  to  the  mapping  just  discussed,  and  P*'  corre¬ 


sponds  to  1/2  Then,  from  Equation  (Al-52)  we  obtain 


Z^r'^2  =  I  u’^'ot'^u 


Since  P  is  Hermitian.  Equation  (Al-53)  yields 


ipi  =  |2ati'^^  =  2'’|at|‘'^ 


Substituting  in  Equation  (Al-46),  we  find  the  desired  form 


f(u)  = 


-i  u  u 


(2rT)-'|at|'^ 


e  z 


(Al-55) 


This  represents  a  conventional  Gaussian  pdf  for  a  real  vector  u  with  zero  mean  value 
and  with  covariance  matrix 


M.  =  Euu  . 


(Al-56) 


If  we  put 
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u 


where 


X 

y 


X  =  [Xi . XjV 


y  ^  [yi . yjr 


then  we  can  write 


M  = 


Exx*  Exy 
Eyx^  Eyy^ 


Comparison  with  Equation  (Al-54)  shows  us  that 


Exx’^=  Eyy'^=  1 


(Al-57) 


(Al-58) 


and 


Eyx"^  -  -Exy"^  =  ■ 

Thus,  the  real  variables  corresponding  to  a  set  of  complex  Gaussian  variables  have  a 
special  covariance  structure,  expressed  by  the  above  equations.  These  relations,  in 
turn,  give  us  the  basic  covariance  properties  of  the  complex  random  vector  itself: 

Ezz^  =  E{xx^  +  yy^)  +  iE(yx'^  -  xy^) 

=  Tr  +  ir,  =  r  (Al-59) 

and 

Ezz'^'  =  E(xx'^  -  yy’’’)  +  iE(yx'''  +  xy’’)  =  0  .  (Al-60) 

Equation  (Al-60)  expresses  the  "circular  symmetry  property,”  which  is  a  necessary 
and  sufficient  condition  for  the  validity  of  the  complex  Gaussian  probability  density 


146 


itself.  Fbr  a  complex  scalar  random  variable,  the  joint  pdf  of  the  real  and  imaginary 
parts  exhibits  circular  symmetry  in  the  x-y  plane. 

F.  COMPLEX  GAUSSIAN  ARRAYS 

Now  let  us  identify  z  with  a  J  x  M-dimensional  array  of  random  variables  Z, 
according  to  the  correspondence  (Al-29).  We  assume  that  the  mean  value  of  Z  is  not 
zero,  but  is  given  by  an  array  Z.  and  that  the  associated  vector  z  has  a  corresponding 
mean  value.  The  circularity  condition  will  then  be  expressed  by  the  relation 

E(Z-Z)i3(Z-ZVi  =  0  .  (Al-61) 

and  the  covariance  matrix  of  Z  will  be  given,  in  general,  by  an  expression  analogous 
to  definition  (Al-39).  The  Gaussian  joint  pdf  of  Z  will  be  a  direct  generalization  of 
Equation  (Al-46). 

We  now  assume  that  the  covariance  of  Z  has  the  special  form  given  in  Equa¬ 
tion  (Al-41).  and  we  associate  the  covariance  matrix  T  of  the  vector  variable  with  the 
Kronecker  product  matrix  B  ©  C*  of  the  Z  array.  The  determinant  of  this  matrix  is 
equal  to  the  right  side  of  Equation  (Al-36).  since  C  is  Hermitian.  and  we  make  use  of 
Elquation  (Al-35)  for  its  inverse.  Equation  (Al-37)  is  then  used  to  evaluate  the  exponent 
of  the  Gaussian  distribution,  completing  the  transition  from  the  vector  form  of  Equa¬ 
tion  (Al-46)  to  the  desired  expression  in  terms  of  the  Z  array  itself.  The  resulting  joint 
pdf  of  the  elements  of  Z  is 


f(Z)  = 


_1 _ 


g-TVlB'^CZ-ZjC'Vz-Z)”] 


(Al-62) 


The  corresponding  volume  element  is  written 
J  M 

d(Z)  -  n  n  d[Re(Z,„)]d[Im(Zj„)) 
j  =  l  m=l 


which  generalizes  Equation  (Al-47). 

Consider  the  linear  transformation 


Z'  =  FZG  . 


(Al-63) 


(Al-64) 
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where  F  and  G  are  square  matrices  of  appropriate  orders.  Then,  according  to  Equa¬ 
tion  (Al-38).  this  is  the  same  as 

z'  =  az  .  (Al-65) 

where  z  corresponds  to  Z.  z'  corresponds  to  Z',  and  a  corresponds  to  the  Kronecker 
product  matrix  F  Identifying  Equation  (Al-65)  with  transformation  (Al-48).  we 
conclude  that  the  Jacobian  of  transformation  (Al-64)  is  given  by 

|aa“|  =  |FF”©gV|  . 

Finally,  the  change  of  volume  element  corresponding  to  this  transformation  can  be 
expressed  in  the  form 

d(Z')  =  |FF”|^  |GG“|-'  d(Z)  .  (Al-66) 

As  an  example,  suppose  that  Z  is  a  Gaussian  array,  subject  to  the  pdf  given  by 
Equation  (Al-62).  and  consider  the  “whitening"  transformation 

Z'  H  B’’^ZC"'^  ,  (Al-67) 

Inverting  this  relation,  we  see  that  the  volume  elements  are  related  according  to  the 
equation 


d(Z)  =  |Bl“|Cl^d(Z')  . 


In  terms  of  the  expected  value  of  the  new  random  array, 
f  =  ET  =  , 

the  joint  pdf  of  Z'  is 


g  -TV((Z  -Z')(Z'-Z')”] 


This  pdf  is,  of  course,  consistent  with  the  new  covariance  matrix 
Cov(Z')  =  1j®1m  • 


(Al-68) 


148 


G.  THE  MULTIVARIATE  CONDITIONAL  GAUSSIAN  DISTRIBUTION 


Let  Z  be  a  Gaussian  array,  of  dimension  JxM.  with  expected  value  Z  and  covari¬ 
ance  given  by 

Cov(Z)  =  E©Im  .  (Al-69) 

This  special  case,  in  which  the  columns  of  Z  are  independent  and  share  a  common 
covariance  matrix  E.  forms  the  setting  for  the  entire  analysis  given  in  the  main  body 
of  this  study.  It  is  also  the  usual  setting  for  discussions  of  multivariate  Gaussian  sta¬ 
tistics  in  the  large  literature  of  that  subject.  The  covariance  matrix  E  is.  of  course,  a 
JxJ  positive-definite  matrix,  and,  with  these  assumptions,  the  joint  pdf  of  Z  assumes 
the  form 


f(Z)  = 


1 


7r 


g-Tr[i:-‘(Z-Z)(Z-2)”] 


(Al-70) 


Let  Uj  be  a  unitary  matrix,  of  order  J,  which  is  partitioned  as  follows: 


Uj  =  {  a  b  1 


(Al-71) 


where  a  has  dimension  Jxj,  b  is  Jxk,  and  j  +  k=J.  Then,  a  and  b  are  basis  arrays  in 
orthogonal  subspaces  of  We  apply  this  matrix  to  Z,  viewing  the  result  as  a  rotation, 
followed  by  a  partitioning  of  the  Z  array.  In  analogy  to  the  many  similar  transforma¬ 
tions  used  in  the  main  text,  we  write  this  operation  in  the  form 


U»Z  = 


a"z 

b”z 


Zl 

u”z  = 

a«Z 

Zi 

*  J 

b”z 

(Al-72) 


where  Zj  has  dimension  j  x  M  and  Zg  is  k  x  M.  As  indicated  by  this  equation,  the  mean 
value  array  Z  is  also  subjected  to  this  rotation  and  partitioning.  The  same  transfor¬ 
mation  is  applied  to  both  the  rows  and  columns  of  the  covariance  matrix  E: 


a“Ea 

a^Eb 

2:,, 

^12 

,  b^Eb 

b^Eb 

^21 

^'22  . 

(Al-73) 


and  also  to  its  inverse: 
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uJe-’Uj  =  (U?SUj)-‘  = 


1 

a«E-‘a 

a«E-‘b 

e“ 

£^2 

.  b«E-'a 

b”E"‘b  . 

£21 

£22 

(Al-74) 


These  equations  serve  to  define  the  components  of  E  and  its  inverse  relative  to  the 
pair  of  subspaces  determined  by  a  and  b. 

We  now  apply  identity  (Al-9)  to  obtain  the  formula 


(Z-Z)”e'*(Z-Z)  =  ((Zi-Zi)“  (Zg-Zg)^ 


r  r;ll 

j,22 


Zi-Zi 

Z2-Z2 


=  y”z"y  +  (Z2-Z2)”2i2(Z2-Z2)  . 


(Al-75) 


where 


Y  s  Zi-Z'i  -  Ei2E22(Z2-Z2)  .  (Al'76) 

We  also  note,  using  Equation  (Al-8),  that 

=  (Ei,-Ei2E22r2j)'^ 

Next,  by  taking  the  trace  of  Equation  (Al-75).  we  obtain 

Tr[z‘\z-2)(Z-Z)”]  =  Tr(E“YY“)  +  Tr{E22(Z2-Z2)(Z2-Z2)^]  • 

FVom  this  result,  we  obtain  the  formula 

f(Z)d('^')  =  fj(Zi|Z2)f2(Z2)d(Zi)d(Z2)  ,  (Al-78) 


where 


(2(^2)  = 


_J _  p-TVlSi'iZg-ZgXZg-Zg)”] 

TT^“|E22t” 


(Al-79) 


and 
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(Al-80) 


fAIZa) 


_ _ 1 _ e--n-[(£i,-£«£a£2,)'’(Z,-Zi2)(Z,-Zi2)”] 

7T^  1^11  ~  Sj2  Eg2 


The  volume  elements  which  appear  in  Equation  (Al-78)  are  all  of  the  kind  defined  by 
Equation  (Al-63),  and  the  Jacobian  of  the  original  unitary  transformation  is.  of  course, 
unity.  Identity  (Al-2)  has  been  used  to  factor  the  determinant  of  E,  and  the  condi¬ 
tional  mean  of  Zj  which  appears  in  Equation  (Al-80)  is  given  by 

Zj2  —  E(/j|Z2)  =  Zj  +  Z|2  E22  (Zg  —  Zg)  ■  (Al-81) 

The  corresponding  conditional  covariance  of  Zj  is 

Cov(Zj|Z2)  =  (Z"y  '  ©1m  .  (Al-82) 


These  formulas  are  straightforward  generalizations  of  standard  results  for  Gauss¬ 
ian  vectors,  expressing  the  pdf  of  Z  as  the  product  of  the  conditional  pdf  of  Zj  (given 
Zg)  and  the  marginal  pdf  of  Zg.  The  conditional  expectation  given  by  Equation  (Al-81) 
is,  of  course,  the  least-squares  predictor  of  Zj  (given  Zg),  and  Y  [defined  in  Equa¬ 
tion  (Al-76)]  is  the  corresponding  prediction  error.  The  conditional  expectation  of  Y  is 
zero,  and  its  conditional  covariance  matrix  is  the  same  as  that  of  Zj. 

H.  SOME  PROPERTIES  OF  COMPLEX  WISHART  MATRICES 

We  return  to  the  untransformed  Gaussian  array  Z  and  assume  that  its  mean 
value  is  zero.  The  object  of  our  discussion  is  the  Jx  J  matrix 

S  s  ZZ“  .  (Al-83) 


We  also  make  the  assumption  that  J  M.  in  which  case  S  is  a  complex  Wishart  matrix 
of  random  variables.  In  accordance  with  the  dimension  of  the  Z  array,  we  say  that  S 
is  of  order  J,  with  M  complex  degrees  of  freedom.  The  notation  CWj(M,E)  is  often  used 
tc  describe  the  distribution  of  S  In  addition  to  the  dimensional  parameters,  it  indi¬ 
cates  the  covariance  matrix  shared  by  the  columns  of  the  original  Gaussian  array 
from  which  S  is  formed.  Whenever  Wishart  matrices  are  discussed,  it  should  be  under¬ 
stood  that  the  actual  covariance  matrix  of  the  underlying  Z  array  has  the  form 
expressed  by  Equation  (A  1-69) 
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A  derivation  of  the  Wisharl  distribution  function  is  given  in  Appendix  3.  We  note 
here  that  S  is  positive  definite  with  probability  one.  according  to  this  distribution.  The 
S  matrix  we  have  defined  here  is  a  "central"  (.omplex  Wishart  matrix,  because  the 
mean  value  of  the  underlying  Gaussian  array  is  zero.  If  this  Gaussian  array  has  a 
non-zero  mean  value,  the  corresponding  S  matrix  is  subject  to  a  non-central  Wisheirt 
distribution.  The  latter  distribution  is  not  explicitly  discussed  in  this  study,  but  some 
of  the  consequences  of  a  non-vanishing  mean  value  for  the  underlying  Gaussian 
array  are  derived  later  on. 

We  recall  the  transformation  of  Z  described  by  Equation  (Al-72)  and  apply  it  to 
the  rows  and  columns  of  S.  The  result  is  a  partitioning  of  S  itself,  according  to  the 
equation 


ujsuj  = 


ZjZf 

7  7^ 

ZgZ" 

Z2Z2 

^11 

Sj2 

S2J 

S22 

(A?-84) 


The  diagonal  blocks  in  this  partitioned  matrix  are  square;  Sjj  is  of  order  j  end  $22  is 
of  order  k,  according  to  the  definitions  used  previously.  The  transformation  is  also 
applied  to  the  inverse  of  S.  and  we  write 


(Al-85) 


We  will  now  show  that  the  matrix 
T  E  (s”)'* 

is  a  complex  Wishart  matrix,  of  order  j,  with  M  -  k  complex  degrees  of  freedom.  In 
addition,  we  will  show  that  T  is  independent  of  the  matrix  block  Si2-  These  properties 
are  indispensable  to  the  analysis  carried  out  in  the  main  text.  Making  use  of  Equa¬ 
tions  (Al-8),  we  can  write 

T  =  Sjj  -  Sj2  S22  Sgi 

~  ^1  (^M  ~  ^  *  ^2)  (AI-86) 
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Recall  that  Zj  is  an  array  of  dimension  jxM,  and  note  that  a  projection  matrix 
appears  in  the  second  line  of  the  expression  for  T.  This  matrix  is  very  similar  to  the 
one  which  occurs  in  Equation  (2-43)  of  Section  2,  and  we  deal  with  it  in  much  the 
same  way. 

First,  an  array  analogous  to  p  is  introduced: 

a  ^  (Z2Z^)''^Z2  .  (Al-e?) 

U 

which  is  possible  because  Z2Z2  is  a  complex  Vishart  matrix  of  dimension  k,  with  M 
complex  degrees  of  freedom.  Since  M  exceeds  k,  this  matrix  is  positive  definite  (with 
probability  one);  hence,  it  has  a  positive-definite  square-root  matrix.  The  properties 

aa“  =  I;, 

a”a  =  z5(72Z2)'‘Z2 

Z2=(Z2Zj)'^a  (Al-88) 

U 

follow  directly  from  the  definition  of  a.  The  projection  matrix  a  a  thus  defines  a 
subspace  c*  dimension  k  of  which  is.  in  fact,  the  row  space  o!  'Iz-  Now.  correspond¬ 
ing  to  the  q  array  of  Section  2,  we  introduce  an  array  which  provides  a  basis  in 
the  orthogonal  complement  of  this  subspace.  This  array  has  the  properties 

w"  -  i„-k 
a/s“  :=  0 

a^a  +  .  (Al-89) 

The  two  sets  of  basis  vectors  form  a  unitary  matrix,  in  analogy  to  Equation  (2-12): 

1  (Al-90) 

,  p  . 

Pinally,  we  decompose  the  array  Zj  into  further  components,  according  to  the 
definition 
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where 


z.“2  '  |Zi«  Zldl 


(Al-91) 


Zla  -  Zl«” 

Zip  s  Zi^”  .  (Al-92) 

Using  this  apparatus,  we  find  that  T  has  the  form 

T  =  =  ZipZfp  (Al-93) 

We  now  condition  on  the  elements  the  Zg  array  so  that  the  subspaces,  as  well  as 
the  bases  introduced  in  them,  become  fixed.  For  brevity  of  notation,  we  will  use  the 
subscript  "2”  to  indicate  this  conditioning.  The  conditional  covariance  of  Zi  (given  Zg) 
is  expressed  by  Equation  (Al-82),  and  a  straightforward  evaluation  [using  Equa¬ 
tion  (Al-44)]  now  gives  us  the  conditional  covariance  matrix 

CovgCZip)  =  (E“)'‘  •  (Al-94) 

Thus,  Zjp  is  a  zero-mean  complex  Gaussian  array  with  independent  columns,  when 
conditioned  on  Zg  As  the  conditioning  variables  themselves  do  not  appear  in  any  way 
in  this  statistical  characterization,  we  have  shown  that  Zip  is  a  zero-mean  complex 
Gaussian  array,  whose  covariance  is  given  by  the  right  side  of  Equation  (Al-04)  when 
the  conditioning  is  removed.  Thus.  T  is  a  complex  Wishart  matrix  of  dimension  j.  The 
number  of  degrees  of  freedom  of  this  distribution  is  M  -  k.  which  is  the  dimensionality 
of  the  subspace  onto  which  projects.  Since  j  =  J  -  k.  we  can  say  that  the  number 
of  degrees  of  freedom  of  T  is  smaller  than  that  of  S  by  the  same  amount  that  its 
dimension  is  less  than  that  of  S.  Taking  cognizance  of  the  covariance  properties  of 
Zip.  we  may  say  that  T  has  the  distribution  CWj(M-k,  Eji-EjgEglEgj). 

The  array  Zj^,  also  has  independent  columns,  and  the  two  components  of  Zi  are 
conditionally  independent.  To  show  this,  we  restore  the  conditioning  on  Zg  and  use 
Fx^uation  (Al-45)  to  make  the  evaluation 

CovgCZi^.Zip)  =  (E")'*  =  0  .  (Al-95) 
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Since 


Zi„  =  ZiZj(Z2Z”r'^  =  SigCZgZ^r^  . 
we  can  write 

S,2  =  Z,„(Z2Z")«  , 
from  which  it  follows  that 

CovgCSj^.Zi^)  =  0  .  (Al-96) 

Under  the  conditioning,  Sjg  and  Zj^  are  zero-mean  Gaussian  arrays,  and  the  vanishing 
of  this  covariance  matrix  implies  that  they  are  independent  os  well.  Independence 
means  that  the  joint  pdf  of  both  arrays  is  the  product  of  the  separate  density  func¬ 
tions.  Since  the  conditional  pdf  of  does  not  depend  on  the  values  of  the  condition¬ 
ing  variables,  the  joint  pdf  remains  a  product  of  factors  when  the  conditioning  is 
removed.  The  unconditioned  pdf  of  Sj2  will,  of  course,  be  different  from  the  condi¬ 
tional  pdf  of  that  array,  but  S12  and  Zj^  are  still  independent  without  the  condition¬ 
ing,  and  it  follows  that  T  is  unconditionally  independent  of  Sj2- 

If  the  Z  array  has  a  mean  value  Z.  then  this  array  is  transformed  and  parti¬ 
tioned.  along  with  Z,  and  its  component  arrays  are  defined  by  Equation  (Al-73).  The 
matrix  S.  defined  by  Equation  (Al-83),  is  now  a  non-central  complex  Wishart  matrix.  It 
can  be  transformed  and  partitioned  as  before,  after  which  its  components  are 
described  by  Equation  (Al-84)  above.  S  is  still  positive  definite  (with  probability  one), 
and  its  inverse  can  also  be  transformed  and  partitioned  according  to  Equation  (Al-85). 
The  T  array  is  defined  as  before,  the  subspace  basis  arrays  are  again  introduced,  and 
the  analysis  up  through  Equation  (Al-93)  is  valid  without  change. 

When  conditioned  on  the  array,  the  covariance  of  Zj  is  still  expressed  by  Equa¬ 
tion  (Al-82),  but  the  conditional  mean  value,  no  longer  zero,  is  given  by  Equa¬ 
tion  (Al-81).  Equation  (Al-94)  still  correctly  describes  the  conditional  covariance  matrix 
of  Zj^,  but  the  conditional  mean  of  this  array  is  now  given  by 

E2Zi^  =  [Zi  +  Ei2E22(Z2-^)]^”  • 


Since 
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=  (ZgZ^)*^  a/?”  =  0  , 

we  can  write 

Eg  Zip  =  .  (AI.97) 

where 

Zi  —  Zi  ^12^22^2  ■  (A1”90) 

The  conditional  probability  density  function  of  Zjp  is  still  Gaussian,  but  the  mean 
value  of  this  pdf  depends  on  the  conditioning  variables  through  the  basis  array  /? 
which  enters  the  conditional  mean.  This  fact  destroys  the  Wishart  character  of  T 
when  the  conditioning  is  removed.  It  also  precludes  the  independence  of  T  and  Sig. 
since  we  can  no  longer  infer  independence  from  the  vanishing  of  the  conditional 
covariance  matrix,  although  Equation  (Al-96)  remains  valid.  In  spite  of  these  compli¬ 
cations.  the  analysis  just  given  is  useful  in  connection  with  another  property  of  the 
Wishart  matrices,  to  which  we  now  turn. 

We  assume  that  Z  is  a  complex  Gaussian  array,  with  a  non-zero  mean  value, 
which  is  partitioned  into  components  Zj  and  Zg.  as  discussed  above  Let  be  a  uni¬ 
tary  matrix  of  order  M,  partitioned  as  follows: 


(Al-99) 


where  c  is  of  dimension  mxM,  d  is  nxM.  and  m  +  n=M.  Then,  c  and  d  form  basis 
arrays  in  complementary  orthogonal  subspaces  of  (II  .We  post-mulliply  the  arrays  Zi 
and  Zg  by  the  Hermitian  transpose  of  Uy.  and  use  its  partitioning  to  define  new 
component  arrays. 


Z,uS  - 

ZzUS  =. 


Zjc”  Zid” 
Zgc”  Zgd" 


(X,  Y,) 
(Xg  Yg)  . 


(Al-lOO) 


We  also  replace  the  restriction  M  by  the  stronger  condition  n. 
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The  transformed  Z  array  is  therefore  partitioned  into  four  components; 


u»zu»  = 


Xg  Yg 


It  is  also  useful  to  introduce  the  notation 


(Al-101) 


ZU[J  s  [  X  Y 


so  that 


(Al-lOa) 


U«X  = 


X,' 


u”y  = 


Yi 

Yz 


(Al-103) 


The  covariance  matrix  of  Z  is  given  by  Equation  (Al-69),  and  1  i-e  covariance  matrices 
of  the  components  X  and  Y  are  easily  found  to  be 


Cov(X)  =  E®1„ 

Cov(Y)^Eel„.  (Al-104) 


The  mean  values  of  the  component  arrays  Xj  and  X2  are  denoted  by  overbars,  and  we 
assume  that  the  means  of  Yj  and  Y2  are  zero.  Then,  we  can  write 


Uj”zu[!  = 


Xj  0 
Xg  0 


(Al-105) 


This  specialization  is  necessary  for  the  results  that  follow,  and  it  is  also  consistent 
with  the  situation  which  arises  in  the  general  problem  formulated  in  the  main  text. 

Making  use  of  Equation  (Al-102),  we  can  express  the  S  matrix  in  the  form 


S  =  zz“  =  XX”  +  Sy  . 


(Al-106) 


where 


Sy 


YY«  . 


(Al-107) 
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Since  Y  has  zero  mean  and  J  <  n,  Sy  is  a  (central)  complex  Wishart  matrix  whose  dis¬ 
tribution  is  CWj(n,I).  and  whose  inverse  exists  with  probability  one.  The  components 
of  S  and  its  inverse,  after  transformation  by  Uj.  are  given  by  Equations  (Al-84)  and 
(Al-85).  We  make  analogous  definitions  for  the  components  of  Sy  and  its  inverse,  after 
the  same  transformation: 


and 


uySyUj  = 


y,y" 


Y  Y*^ 

YaYf  Y5Y 


H 
2‘2 


Sy 

^IJ 

Sy 

Yi2 

Sy 

L  ‘a 

Sy 

*22 

r  ^11 

by 


.12  1 


S?‘  sf 


(Al-108) 


(Al-109) 


By  our  previous  results,  the  j  x  j  matrix 

Ty  s  (s”)'‘  =  Yi[l„  -  yJ(Y2Y“)'W2]  y” 
is  a  (central)  complex  Wishart  matrix.  We  define 


oy  .  (YaY?)-^  Yj  . 


(Al-110) 


which  is  the  analog  of  a  in  the  previous  analysis,  and  which  serves  as  a  basis  array  in 
the  k-dimensional  row  space  of  Y2.  We  also  introduce  the  array  ^y,  analogous  to 
which  is  a  basis  array  in  the  (n  -  k)-dimensional  orthogonal  complement  of  this  row 
space.  It  follows  that 

•n-k  • 

and  that 

Oy  Oy  +  ^y  ^y  =  lj.j  . 

Finally,  in  analogy  to  Equation  (At-93).  we  have 
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where 


Ty  =  Y,^Y[i  . 


(Al-111) 


Vi^  =  .  (Al-n2) 

Yj^  is  a  zero-mean  complex  Gaussian  array,  whose  covariance  matrix  is 

Cov(Yi^)  =  (Al-113) 

This  formula  completes  the  characterization  of  Ty  as  a  complex  Wishart  matrix  by 
showing  that  it  has  n  -  k  complex  degrees  of  freedom,  and  by  exhibiting  the  covari¬ 
ance  matrix  shared  by  the  columns  of  the  underlying  Gaussian  array  Yi/J- 

The  matrix  S,  formed  from  the  full  Z  array,  is  subject  to  a  non-central  complex 
Wishart  distribution.  As  noted  above,  we  can  still  introduce  the  matrix 

T  ^  =  Zi[Im  -  .  (Al-114) 

and  the  basis  array  a  of  the  row  space  of  Zg: 

a  s  (ZgZjr'^  Z2  (Al-115) 

Then,  we  have 

T  =  Zi(1m  -  a“a)z”  .  (Al-116) 

It  will  now  be  shown  that  T  can  be  expressed  in  terms  of  Ty,  in  the  form 

T  =  +  Ty  .  (Al-117) 

where  (  is  a  j  x  m  array,  independent  of  Ty.  whose  st.atistical  characteristics  will  sub¬ 
sequently  be  derived.  Equation  (Al-llT)  resembles  Equation  (Al-106),  and  f  (like  X)  will 
have  a  non-vanishing  mean  value  which  is  dependent  on  the  components  of  the  orig¬ 
inal  mean  array  Z. 
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lb  establish  this  result,  we  must  find  a  link  between  the  subspace  decompositions 
described  by  Oy  and  ^y,  which  relate  to  the  row  space  of  Y2.  and  that  described  by  a, 
our  basis  in  the  row  space  of  Zg-  We  define  the  array 

^E=l0^y]UM.  (Al-118) 

in  which  the  null  array  is  of  dimension  (n-k)xm.  We  observe  that  the  rows  of  P2 
orthonormal: 

^2^2  "=  (  0  ^y1  “  ^n-k  • 

IpyJ 

Since  /Sy  is  orthogonal  to  the  row  space  of  Yg.  the  extended  array  [0  /Sy]  is  orthogonal 
to  the  row  space  of  [Xg  Yg].  Post-multiplication  by  the  unitary  matrix  Uy  produces 
an  array  which  is  orthogonal  to  the  row  space  of  Zg: 

0 

=  Yg^;  =  (YgY^)*^  oy^i;  =  0  .  (Al-119) 

and  this  relation  provides  the  link  we  seek.  We  do  not  expect,  however,  that  /Jg  will 
provide  a  basis  for  the  full  orthogonal  complement  of  this  row  space. 

The  span  of  a  is  k-dimensional,  while  that  of  /Sg  is  of  dimension  (n-k).  These 
spaces  are  orthogonal  but  they  do  not  exhaust  <1*^.  and  there  is  an  m-dimensional 
subspace  left  over  which  is  orthogonal  to  the  spans  of  both  a  and  /Sg.  Let  be  an 
orthonormal  basis  array  in  this  remaining  subspace,  so  that  we  have 

H  T 

an  =  Ijj 

iSg/?^  =  In-k  -  (Al-120) 

and 

o."c<  +  +  ^5^2  =  I„  (Ai-iai) 


ZsP"  =  Zal-'K  „  =  (Xj  Yj] 

LPyJ 
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R'om  the  latter  relation,  together  with  Equation  (Al-116).  we  obtain 


But 

H  u  0  ,  ,0 

Zi  ^2  =  Zj  Uj^  u  =  [  Xj  Yj  ]  o 

IpyJ  IpyJ 

=  Yi/S?  =  Yi^  .  (Al-122) 

in  direct  analogy  to  the  derivation  of  Equation  (Al-119).  and,  therefore, 

T  =  Zi/sf^jZ”  +  Y,^y”  =  Xi^x”  +  Ty  .  (Al-123) 

where 

Xi^  ^  Zl/?r  (Al-124) 

A  similar  formula,  expressing  Yj^  directly  in  terms  of  Zj,  is  provided  by  Equa¬ 
tion  (Al-122). 

We  condition  on  the  elements  of  the  Z2  array,  which  includes  the  array  Y2;  thus, 
all  the  subspaces  and  the  basis  arrays  introduced  in  them  are  now  fixed.  Under  this 
conditioning,  Xj^  and  Yj^  are  complex  Gaussian  arrays,  the  latter  with  zero  mean. 
Using  definition  (Al-124)  and  Equation  (Al-122),  we  evaluate  the  conditional  covariance 
matrices  of  these  arrays; 

Cov2(Xi^)  =  (e“)'‘  ®(/?i^;^)*  =  (E“)'‘ 

Cov2(Y,^)  =  (E“)-'®(^2/S?r  =  (E“)'Uln.k  - 

These  results  are  consequences  of  Equation  (Al-82).  of  course,  and,  as  they  do  not 
depend  on  the  values  of  the  conditioning  variables,  they  remain  valid  when  the  con¬ 
ditioning  is  removed.  Thus,  Equation  (Al-113)  (which  expresses  the  unconditioned 
covariance  matrix  of  Y,^)  is  recovered,  and  we  also  have 

Cov(Xi^)  -  (E“)*Ulnn  ■  (Al-125) 
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Since  /?i  and  ^2  basis  arrays  of  orthogonal  subspaces,  we  see  that  and  Yj^  are 
conditionally  uncorrelated; 

Cov2(Xip,Yi^)  =  =  0  .  (A1.126) 

This  equation  implies  independence  when  the  conditioning  is  removed,  since  the  con¬ 
ditional  probability  density  function  of  Y^^  (which  has  zero  mean)  does  not  depend  in 
any  way  on  the  values  of  the  conditioning  variables.  Thus.  Ty  itself  is  independent  of 

It  remains  only  to  discuss  the  mean  value  of  the  array  Xj^  and  to  identify  the 
array  ^  to  complete  the  proof  of  our  assertion,  expressed  by  Equation  (Al-llT).  We 
begin  with  the  conditioning  on  Z2  in  effect,  and.  from  definition  (Al-124).  we  obtain 

£2X1^  =  (EgZi)^”  . 

Equation  (Al-81),  which  is  applicable  to  the  present  analysis,  states  that 


E2Z1  = 


^  ^12^22(^2  ^2^ 


Since 


Za^f  =  (Z2Zj)'^a/?”  =  0  . 

we  obtain 

=  (Zj  -  2,2^22  Zg)  .  (Al-127) 

in  direct  analogy  to  our  earlier  discussion  of  the  effects  of  a  non-zero  mean  value  on 
the  properties  of  Wishart  matrices.  Fbllowing  that  discussion  another  step,  we  make 
the  definition 

Xj  =  Xj  -  EjgSagXg  .  (Al-128) 

Fbom  Equations  (Al-lOO).  we  deduce  that 

(Z,  -  =  liii  0  1  , 
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since  the  Y-components  have  zero  means.  Combining  these  resvilts  and  recalling 
Equation  (Al-99).  we  obtain 

=  [Xi  0  )  =  XiC^”  .  (A1.129) 

The  Xip  array  is  of  dimension  jxm.  We  let  be  a  unitary  matrix,  of  order  m. 
which  will  be  precisely  defined  later.  This  matrix  will  be  a  function  of  the  condition¬ 
ing  variables,  but  it  is  constant  under  the  conditioning.  We  also  define  ^  in  terms  of 
as  follows: 


^  (Al-130) 

Obviously,  we  have 

T  =  +  Ty  .  (Al-131) 

so  that  the  form  of  this  representation  of  T  is  not  affected  by  the  choice  of  ^  is 
a  Gaussian  array  under  the  conditioning,  with  the  same  covariance  matrix  as  Xj^. 
The  conditional  mean  of  ^  is,  of  course, 

Ejf  -  5(,c/9>!i 

Let  us  put 

(Al-132) 

and  observe  that  'V'  is  a  square  matrix,  of  order  m.  since  c  and  are  both  of  dimen¬ 
sion  m  X  M.  We  now  evaluate 

=  c/?"^ic“  . 

Making  use  of  Equation  (Al-121).  we  have 

V'V'”  =  '  «”a)c“  , 

and,  from  definitions  (Al‘99)  and  (Al-118),  it  follows  that 
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We  have  therefore  found  that 

=  c(Im  -  a”a)c” 

=  -  cZj{Z2Z?r‘Z2c” 

u 

The  fact  that  cc  =1^  follows  from  the  unitary  character  of  Uj^.  FVom  Equa¬ 
tion  (Al-IOO),  we  now  obtain 

^2  (X2X2  +  Y2Y»)-‘  X2 

=  [im  +  .  (A1.133) 

the  last  step  being  an  application  of  Equation  (Al-5). 

We  define 

Cm  "  Im  +  X»(Y2Y»)-‘X2.  (AI-134) 


so  that 


V'/  =  c;;,* , 

and  observe  that  is  a  positive-definite  matrix,  which  is  constant  under  the  cond  - 
tioning.  It  follows  that  V'  is  non-singular  and  that 

is  unitary.  We  now  make  the  deferred  choice 

',1^^  =  .  (Al-135) 

and  we  find  that 
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=  c-^  . 


Finally,  we  obtain  the  desired  form 

Eg^  =  =  XjC-^  .  (Al-136) 

The  conditioning  variables  survive  only  through  the  matrix  C„,  whose  statistical 
character  (when  the  conditioning  is  removed)  we  now  investigate.  Yg  is  a  zero»mean 
complex  Gaussian  array,  whose  covariance  matrix  is 

Cov(Y2)  =  EggOlj,  . 

in  agreement  with  Equation  (Al-79)  Therefore. 

Sy^  =  YgY”  (A1.137) 

is  a  complex  Wishart  matrix,  of  order  k,  and  with  n  complex  degrees  of  freedom.  In 
the  notation  used  earlier,  its  distribution  is  CWj^(n,E22)  T’he  Xg  array  is  also  complex 
Gaussian,  independent  of  Yg,  with  mean  and  covariance  arrays  given  by 

EXg  =  Xg 
Cov(X2)  =  ^22®^m 

We  have  shown  that  T  can  be  expressed  in  the  form  given  in  Equation  (Al-117). 
where  the  (  array  is  statistically  independent  of  the  complex  Wishart  matrix  Ty  We 
have  also  seen  that  (  is  conditionally  Gaussian,  with  conditional  mean  value 

E(^IC^)  =  x.c-^  ,  (Ai-isa) 

and  with  the  unconditioned  covariance  matrix 

Cov(0  =  .  (Al-139) 

We  can  express  these  properties  in  a  convenient  way  by  making  the  definition 

^  ^  .  (A1.140) 
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where 


(Al-141) 

Then,  is  a  zero-mean  complex  Gaussian  array,  with  covariance  matrix 

Cov(e„)  =  (£“)■’  ®1^  ,  (A1.142) 


and  the  three  quantities  Ty,  are  statistically  independent  The  statistical 

characterization  of  is  provided  by  the  definitions  (Al-141).  (Al-128).  and  (Al-134), 
together  with  the  properties  just  established  for  the  complex  Gaussian  arrays  X2  and 

Ye- 

The  matrix  belongs  to  a  family  of  complex  random  matrices  which  are  gen¬ 
eralizations  of  the  16  matrices  introduced  in  Section  4.  The  generalization  lies  with  the 
fact  that  the  Xg  array  has  a  non-zero  mean.  A  special  case  of  this  generalized  ^ 
matrix  was  discussed  in  Sections  5  and  6.  in  connection  with  the  presence  of  "signal 
mismatch,"  a  feature  introduced  in  Section  3.  The  €  matrices  are  also  discussed  in 
Appendix  3,  where  their  relation  to  the  complex  multivariate  F  and  Beta  variables  is 
established. 

As  an  application  of  these  results,  consider  the  ratio 


|7|  ^  la^Sy'al  ^  la^Sy^aj 

|a“s'‘a|  |a“(Sy  +  Xx“)‘^  al’ 


(Al-143) 


This  quantity  has  exactly  the  same  form  as  one  of  the  versions  of  the  GLR  test  sta¬ 
tistic,  obtained  in  Section  2  and  expressed  by  Equation  (2-56).  Using  Equation  (Al-131), 
we  can  wiite 


+  Ty!  „  , 

I  =  (  Ty^el  .  (Al-144) 

which  is  directly  analogous  to  Equation  (3-15)  of  Section  3.  With  the  appropriate  iden¬ 
tifications  of  terms,  we  can  therefore  use  the  results  obtained  here  to  derive  the  sta¬ 
tistical  properties  of  the  GLR  test,  starting  from  Elquation  (2-56)  and  leading  to  Equa¬ 
tion  (3-15),  with  "signal  mismatch"  included. 
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APPENDIX  2 

COMPLEX  DISTRIBUTIONS  RELATED  TO  THE  GAUSSIAN 


We  introduce  here  the  complex  analogs  of  the  chi-squared.  F,  and  Beta  distribu¬ 
tions.  In  real-variable  statistics  these  distributions  are  usually  treated  as  a  family, 
based  on  their  definitions  in  terms  of  real  Gaussian  vector  variables.  The  complex  dis¬ 
tributions  bear  the  same  relationship  to  one  or  more  complex  Gaussian  vectors  of  the 
kind  discussed  in  Appendix  1. 

Let  u  be  a  complex  Gaussian  vector,  of  dimension  n,  with  zero  mean  and  covari¬ 
ance  matrix  l^-  The  components  of  this  vector  are  independent,  with  "complex  vari¬ 
ance"  unity; 

Elu/  -  1 

Each  component  represents  a  pair  of  independent  real  variables,  both  of  which  have 
mean  zero  and  variance  one-half.  The  scalar 


y 


u“u  =  Tr(uu“)  =  ^  !u,f 


I**  1 


(A2-1) 


will  be  called  a  comple\  chi-squared  random  variable,  with  n  complex  degrees  of  free¬ 
dom.  This  usage  difiers  from  that  of  real-variable  statistics,  where  2y  would  be  called 
chi-squared,  with  2n  degrees  of  freedom. 

The  pdf  of  y  is  given  by  the  familiar  formula 


My-")  = 


(A2-2) 


The  cumulative  distribution  function  of  y  is  1  -  G_(y),  where 


oo 

.w- 1 


Gp(y)  =  I  f;,(y':n)dy'  =  ^  . 

k=0 


(A2-3) 
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This  function,  which  appears  elsewhere  in  the  analysis,  is  the  incomplete  Gamma 
function.^^ 

When  the  means  of  the  underlying  Gaussian  vectors  of  any  of  these  distributions 
are  zero,  the  corresponding  distribution  is  called  "central.”  The  non-  central  complex 
chi-squared  variable  is  still  defined  by  Equation  (A2-1),  but  the  mean  vector  of  u  is  no 
longer  zero.  The  non-central  complex  chi-squared  pdf  depends  on  this  mean  only 
through  the  scalar  "non-centrality  parameter" 

n 

c  ^  Y.  |Eu/  =  (Eu)“Eu  .  (A2-4) 

i  =  l 

The  corresponding  pdf  is 

yy;n|c)  =  (y/c)^*‘^^^  In_i(2s/cy )  ,  (A2-5) 

which  is  well  known  in  radar  detection  theory.  In  this  formula,  Ij,  is  the  modified 
Bessel  function,  and  the  series  obtained  from  its  definition, 


(A2-6) 


is  a  hypergeometric  function.  Thus,  Equation  (A2-5)  may  be  written  in  the  form 


f;^(y:nlc)  =  f^(y;n)e'‘^  oF,(n;cy)  .  (A2-7) 

The  cumulative  non-central  com|lex  chi-squared  distribution  is,  of  course,  directly 
related  to  the  Marcum  Q-function^ 

The  ratio  of  two  complex  chi-squared  variables  obeys  the  complex  F  distribution. 
Let  u  be  a  zero-mean  complex  Gaussian  vector,  as  before,  and  let  w  be  an  independent 
complex  Gaussian  vector,  of  dimension  ni.  The  mean  of  w  is  also  zero,  and  its  covari¬ 
ance  matrix  is  I^.  The  ratio 
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X 


(A2-8) 


=  ^  ^ 
w»w 


Ei»/ 

j  =  l 


will  be  called  a  complex  central  F  random  variable.  We  signify  this  by  writing 
X  =  Xp(n.m)  . 

The  symbol  on  the  right  is  a  generic  designator,  rather  than  a  specific  random  vari¬ 
able.  The  pdf  of  the  complex  central  F  variable  follows  easily  from  the  standard  for¬ 
mula  for  the  pdf  of  a  ratio  of  random  variables; 


fp(x;n.m)  = 


J  f^(xy;n)  f^(y;m)ydy 


(n  +  m-1)!  x*^'^ 

(n-l)!(m-l)!  + 


(A2-9) 


The  complex  central  Beta  variable  is  closely  related  to  the  F  variable.  If  u  and  w 
have  the  same  meanings  as  before,  then 


E  I-/ 

Eiu,f.Ei»/ 

i-i  j-i  ^  ' 


(A2-10) 


will  be  called  a  complex  central  Beta  random  variable.  We  use  the  generic  notation 
p  =  x^(n.m) 

to  signify  this  statistical  character.  Fhom  Equation  (A2-10).  we  obviously  have 


Xo(n.m)  =  ; - 7 - ^  . 

P  1  +  Xp(m,n) 


(A2-11) 
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Observe  the  transposition  of  parameters  in  this  relationship,  which  occurs  because  we 
have  retained  some  of  the  conventions  of  real-variable  statistics  in  making  these 
definitions  The  pdf  of  the  complex  central  Bela  is  obtained  from  that  of  the  complex 
central  F  by  a  simple  change  of  variable; 

(A2-12) 

The  cumulative  complex  central  Beta  distribution  is  defined  as 


H 

Fp(p;n.m)  s  J f^(p';n .m)dp'  . 


(A2-13) 


and  it  is  given  by 


26 


m-l 


Fp(p;n.m)  = 


m-l 

=  -  f/»(p;n  +  m-k,k-rl) 

n-l 

=  1  S  fp(p:n-k;m-Hk  +  l) 


(A2-14) 


This  result  is  easily  verified  by  repeated  partial  integration,  proceeding  directly  from 
definition  (A2-13). 

The  cumulative  complex  central  F  distribution  is  defined  in  a  similar  way: 


Fp(x;n,m) 


X 

J  fp(x  ;n,m)dx'  . 
0 


In  view  of  Equation  (A2-11),  we  have 

Fp{x;n,m)  =  1  -  F^(l/(l-t-x);m,n)  , 


(A2-15) 
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from  which  we  obtain  the  analog  of  Equation  (A2-14): 


Fp(x:n.m) 


(A2-16) 


The  non-central  complex  F  variable  is  still  defined  by  Equation  (A2-8).  but  the 
mean  value  vector  of  u  is  no  longer  zero.  Being  the  ratio  of  a  non-central  complex 
chi-squared  variable  to  a  central  one.  the  non-central  complex  P  distribution  can 
depend  on  the  mean  of  u  only  through  the  non-centrality  parameter  c.  defined  in 
Equation  (A2-4).  We  use  the  generic  notation 

X  =  Xp(n,m|c) 

for  this  random  variable.  Its  pdf  is  evaluated  from  the  integral 


fp(x;n,m|c) 


xy;nlc)f^(y;m)ydy  . 


0 


(A2-17) 


by  substituting  the  series  (A2-6)  in  the  non-central  complex  chi-squared  density,  and 
performing  the  integration  term  by  term.  The  resulting  series  is  recognized  as  a 
confluent  hypergeometric  function: 


fp(x;n,m|c)  =  fp(x;n.m)  e*' jFj[n+m;n;cx/(l  +  x)]  .  (A2-16) 

The  non-central  complex  Beta  variable  is  defined  by  the  generic  relation 

x«(n,mlc)  =  ; - , 

p  1  H  xp(m.n|c) 

and  its  pdf  follows  directly  from  Equation  (A2-18)  by  means  of  a  change  of  variable: 

fp(p;n.m|c)  =  f^(p;n,m)  e'®  |Fj(n  +  m;m;c(l-p)]  .  (A2-19) 

31 

In  order  to  make  connection  with  the  notation  of  real-variable  statistics,  we  must 
recall  that  the  real  dimensional  parameters  corresponding  to  n  and  m  are  2n  and 
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2m,  respectively,  and  that  the  real  non-centrality  parameter  is  2c  because  of  our  con¬ 
vention  for  the  variances  of  our  complex  Gaussian  variables. 

If  the  defining  series  for  the  confluent  hypergeometric  function^^  is  substituted 
in  Equation  (A2-19),  the  non-central  complex  Beta  pdf  assumes  the  interesting  form; 


fp(/5;n,m|c) 


e'*"  £  f^(p;n;m  +  k)  ^  . 
k«0 


(A2-20) 


This  distribution  can  also  be  expressed  in  finite  form,  by  making  use  of  some 
well-known  prcyerties  of  the  confluent  hypergeometric  function.  First,  the  Kummer 
transformation 

jFj(n:m;x)  =  e*  jFi(m -n;m;-x)  (A2-21) 

is  applied  to  Equation  (A2-19).  which  results  in  a  hypergeometric  function  whose  first 
parameter  is  a  non- positive  integer.  Rinctions  of  this  kind  reduce  to  polynomials, 
according  to^^'^® 


iFj(-n;m;x)  = 

k=0 


n!  (m  -1)!  (-x)*^ 

(n-k)!  (m+k~l)!  k! 


(A2-22) 


provided  n  ^  0.  Combining  these  facts,  we  obtain  the  result 


f^(p;n,rri|c)  =  f^(p:n.m)e~*^^  (irT+iT-i)'! 

(i+m  +  k-\)!^'' f^(p;n;m  +  k) 


=  c-"-" 


(A2-23) 


A  similar  expression  can  be  derived  for  the  non-central  complex  F  distribution: 
tp(x;n.m|c)  =  £  (”)  (^7^^!  (  )"  ' 
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The  cumulative  non-central  complex  Beta  distribution  is  defined  by 

P 

F^{/3;n.m|c)  s  J  f^(p';n.mlc)dp'  .  (A2-25) 

0 

We  substitute  Equation  (A2-20)  in  the  integral  {A2-25)  and  use  Equation  (A2-14)  to 
evaluate  the  typical  term: 


F^(p.n.m-^k) 


_n+m+k- 


n-l/,  \m+k  ^  /n  +  m  +  k  — 1\/ 


1  -  p 


LipV 

p  / 


Combining  these  results,  we  find 

Fo(p.n.mlc)  =  I  -  e'^p^  *(l-p)^ 

X  V  slliLlEl*'  /n -i- m k - 1\  /  1  -  p y 
k=0  }\  P  J  ' 

Reversing  the  order  of  summation,  we  again  recognize  the  series  as  a  confluent 
hypergeometric  function,  and  thus 


F^(p;n.m|c) 


1  - 


p"-‘(l-pr 


n-l 

s 

J=0 


(n-tm-1);  /  1  -  p \j 

(n-j-l)!(j  +  m)!  \  p  / 


X  e  jFj[n  +  m;j  +  m  +  l;c(l-p)]  . 


The  Kummer  transformation  can  be  applied  once  more,  and,  with  the  help  of  Equa¬ 
tions  (A2-21)  and  (A2-22),  we  obtain 


The  summation  indices  are  now  changed  by  introducing  the  sum  j  +  k  as  a  new  index 
in  place  of  j.  The  new  index  is  then  called  k,  and  the  incomplete  Gamma  function 
(Ekjuation  (A2-3)]  is  introduced.  The  result  is 


Fp(p;n.m|c) 


1  - 


Gk.„(cp)  .(A2-26) 


or.  finally. 


F^(p;n.mlc)  •-=  1-  — ^  J]  f^(p;n-k.m  +  k  +  l)  G^+l(cp)  .  (A2-27) 

“  ^  k=0 

When  c  is  zero  the  G^  functions  are  all  equal  to  unity,  hence  Equation  (A2-27)  reduces 
to  Equation  (A2-14). 

The  cumulative  non-central  complex  F  distribution; 


A 

Fp(x;n,mic)  s  J*  fp(x';n,mlc)dx'  . 


(A2-28) 


is  obtained  from  that  of  the  non-central  complex  Beta  by  the  same  procedure  used  in 
the  central  case.  We  have 


Fp(x:n.m|c)  =  1  -  F^[l/(l  +  x);m,n|c] 

m-i 

E 

k=0 


and,  finally 


F,(x,„.mlc)  .  E  ("i™-')  x-  .  (AE.29) 


When  c  =  0,  Equation  (A2-29)  reverts  immediately  to  Equation  (A2-16).  In  Reference  5, 
formulas  (A2-20),  (A2-23),  and  (A2-29)  are  derived  by  a  different  technique,  starting 
directly  from  the  Gaussian  distribution. 
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APPENDIX  3 

INTEGRATION  LEMMAS  AND  INTEGRAL  REPRESENTATIONS 


In  this  Appendix  we  discuss  the  properties  of  certain  random  matrices  from  a 
different  point  of  view  than  the  one  employed  in  the  text.  Some  results  obtained 
already  are  re-derived,  and  some  new  ones  (needed  in  the  main  analysis)  are  derived 
here.  The  approach  is  based  on  a  general  technique  of  multiple  integration,  which  is 
applied  to  derive  the  multivariate  generalizations  of  the  complex  F  and  Beta  distribu¬ 
tions.  This  technique  also  provides  a  very  direct  derivation  of  the  Wishart  pdf  itself. 
The  analysis  is  confined  to  the  “central"  case,  in  which  all  the  Gaussian  arrays  which 
appear  have  mean  values  of  zero  Specific  applications  are  made  to  the  GLR  test  sta¬ 
tistic,  in  the  special  case  in  which  no  signal  components  are  present. 

In  Appendix  1  we  discussed  some  properties  of  multiple  integration  in  which  the 
variables  of  integral  on  are  the  complex-valued  elements  of  an  array.  This  array  is 
generally  rectangular  in  shape,  and  the  volume  element  is  called  d(Z).  The  dimension¬ 
ality  of  the  underlying  real  space  is  twice  the  number  of  elements  in  Z,  and  integra¬ 
tion  is  carried  out  with  respect  to  the  ordinary  Euclidean  measure  in  this  space.  The 
fact  that  we  describe  the  integration  variables  in  terms  of  a  complex  array  Z  has  no 
impact  on  the  character  of  integration  in  this  case.  The  integration  technique  we 
introduce  here  is  based  on  another  space,  whose  elements  (points)  are  Hermitian 
matrices  of  order  J. 

Let  A  and  B  be  J  x  J  Hermitian  matrices,  and  let  x  and  y  be  real  numbers.  Then, 
the  Hermitian  matrix  xA  +  yB  is  also  a  point  in  our  space,  which  is  therefore  shown 
to  be  a  real  vector  space.  We  introduce  an  inner  product  in  this  space,  as  follows; 

[A.B]  =  Tr(AB)  .  (A3-1) 

It  is  easily  verified  that  this  definition  satisfies  the  requirements  of  an  inner  product 
in  a  real  vector  space.  In  particular,  it  is  a  symmetric  function  f  A  end  B  as  a  result 
of  an  elementary  property  of  the  frace  operator  which  we  have  frequently  utilized. 
The  squared  norm  of  a  vector  in  the  space  is  given  by 

J 

l|Af  =  [A.A]  =  x;  lA.J^  (A3-2) 

i.j  =  l 

which  is  one  of  the  several  norms  commonly  used  in  connection  with  matrices. 
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2 

A  Hermitian  matrix  of  order  J  if?  described  by  J  real  numbers,  hence  the  new 
space  is  of  dimension  J^.  We  can  map  its  points  onto  a  real  space  of  J®  dimensions,  as 
follows  Let  the  real  variables  aj...aj  be  equal  to  the  diagonal  elements  of  the  Her¬ 
mitian  matrix  A: 

aj  s  Ajj  1  <  j  <  J  .  (A3-3) 

and  let 

®j+i  ^  (A3-4) 

Continuing  in  this  way,  pairs  of  real  variables  are  defined  in  terms  of  the  remaining 
complex  elements  of  A  which  lie  above  the  main  diagonal.  The  reason  the  square  root 
of  2  is  included  in  these  definitions  will  become  apparent  shortly. 

Let  A  and  B  be  Hermitian  matrices,  and  let  a  and  b  stand  for  the  real  vectors,  of 
dimension  J  ,  which  correspond  to  them  according  to  the  mapping  just  defined: 

A  < — *  a  .  B  < — >  b  . 

Then,  we  can  evaluate  the  inner  product  of  A  and  B  in  terms  of  a  and  b,  as  follows 
J 

[A.Bl  =  £ 
i.j  =  l 

J 

==  Z  +  Yj  (AgB’j  +  A*jBjj) 

j  =  l 
J2 

=  Y  Qjbj  =  (a,b)  .  (A3-5) 

J=i 

The  last  form  is  the  conventional  inner  product  in  the  real  space  which  contains  a 
and  L.  We  have  shown  that  the  mapping  defined  above  preserves  inner  products,  and 
thus  also  norms,  with  our  definitions  of  these  quantities. 

The  mapping  is  now  applied  to  sets  of  points  in  the  two  spaces,  and  then  used  to 
define  a  measure,  i.e ,  a  definition  of  integration,  in  the  space  of  Hermitian  matrices. 
The  measure  of  a  set  in  the  latter  space  is  defined  to  be  proportional  to  the  ordinary 
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Euclidean  measure  of  the  corresponding  set  in  the  real  space  of  dimension  J^.  In  the 
latter  space,  the  volume  element  of  integration  is  given  by 

dV  s  dajda2...daj2  , 

and  in  the  new  space  it  will  be  taken  to  be 
J 

d(A)s  ncl(Ak,k)  n  d[Re(A,j)]d[Im{Aij)]  .  (A3-6) 

k=l 


We  therefore  have 

dV  =  . 

and  this  relation  establishes  the  proportionality  constant  between  the  two  measures. 
In  the  analysis  to  follow,  we  will  limit  all  integrals  in  the  new  space  to  the  subspace 
of  Hermitian  matrices  which  are  non-negative  definite.  This  restriction  will  be  indi¬ 
cated  by  the  use  of  the  notation  dQ(A)  for  the  volume  element  of  integration. 

The  two  integration  concepts  are  closely  related,  as  shown  by  the  following  prop¬ 
erty.  Let  Z  be  an  array  of  variables,  of  dimension  JxM,  ..here  J^M.  Then,  if  9  is  any 
well-behaved  function  whose  argument  is  a  square  matrix,  the  identity 

|sf(ZZ»)d(Z)  =  j9(S)|Sl“‘''do{S)  (A3-7) 


holds,  so  long  as  the  integrals  themselves  exist,  where 

rj(K)  =  n  r(K-j) 

j  =  0 


(A3-8) 


This  quantity,  which  is  a  generalization  of  the  Gamma  function,  will  appear  fre¬ 
quently  in  the  following  discussion,  and  we  note  that  rj(K)  =  r(K). 

The  integration  identit)  can  be  derived  directly  from  geometric  considerations, 
and  a  detailed  exposition  of  the  theorem  (for  the  case  of  real  variables)  may  be  found 
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in  Chapter  2  of  Reference  10  which  contains  further  references  to  the  literature.  We 
give  an  inductive  proof  for  the  comphx  case  later  in  this  Appendix,  using  only  ele¬ 
mentary  matrix  methods.  These  are,  in  fact,  the  same  methods  of  projection  and  par¬ 
titioning  which  are  utilized  repeatedly  in  the  main  body  of  this  study.  Before  pro¬ 
ceeding  with  tnis  proof,  we  first  show  some  of  the  consequences  of  Equation  (A3-7), 
beginning  with  a  derivation  of  the  Wishart  pdf  which  is  simpler  than  the  conven¬ 
tional  procedure.^  ^ 

Let  Z  be  a  complex  Gaussian  array,  of  dimension  J  x  (J  +  K),  with  mean  value  zero, 
and  with  covariance  matrix 

Cov(Z)  -  . 

where  K  S  0.  Then,  the  expected  value  of  an  arbitrary  function  of  the  product 
T  =  ZZ” 

can  be  evaluated  as  the  integral 

E5(T)  =  -J— j5'(ZZ”)e*''^^^^”^d(Z)  .  (A3-9) 

taken  over  the  pdf  of  2.  The  latter  is  a  special  case  of  Equation  (A1-6B)  of  Appendix  1, 
with  the  mean  value  replaced  by  zero.  Applying  Equation  (A3-7}  to  this  integral,  we 
obtain 


E5*(T)  = 


1 

rj(J-^K) 


5»(S)|S|’^e''^^®)  do(S) 


It  follows  immediately  that  the  joint  pdf  of  the  elements  of  T  is  the  complex  Wishart 
density 


fvf(T;J,K|l)  = 


rj(J  +  K) 


|T|Ke-TV(T)  , 


(A3-10) 
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This  notation  (which  is  not  standard)  is  chosen  to  exhibit  the  complex  Wishart  pdf  as 
a  direct  generalization  of  the  complex  chi-squared  distribution.  In  the  present  case, 
the  matrix  dimension  is  J  and  the  Wishart  density  has  J  +  K  complex  degrees  of  free¬ 
dom.  If  Z  has  the  more  general  covariance  matrix 

Cov(Z)  =  , 

then  Equation  (A3-9)  is  replaced  by 

.'.pplying  Equation  (A3-7)  again,  we  obtain 


ESfCT)  = 


J  y(S)  fvy(S;J,KlE)do(S)  . 


wheri! 


fw(T;J.K.i2) 


_ L._ 

rj(J  +  K) 


(A3-11) 


Nvhich  is  the  general  case  of  the  complex  Wishart  density. 

As  another  application  of  Equation  (A3-7),  we  derive  the  Jacobian  for  the  linear 
transiormation  of  variables 


S  -  GSG”  .  (A3-12) 

where  S  is  a  matrix  of  complex  variables  of  integration,  and  the  volume  element  is 
defined  by  Equation  (A3-6).  The  matrix  G  is,  of  course,  non-singular.  Any  integral  over 
S  can  be  expressed  as  an  integral  over  a  J  x  j  array  Z  of  unconstrained  complex  vari¬ 
ables,  as  lollows: 
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J5(zz”)d(z). 


The  validity  of  this  representation  is  a  special  case  of  Equation  (A3-7).  Now  let  us 
introduce  the  c!  ange  of  variables 

Z  =  GZ  ,  d(Z)  =  |GG”|''d(Z)  .  (A3-13) 

with  Jacobian  as  shown.  The  latter  is  a  special  case  of  Equation  (Al«66)  of  Appendix  1. 
Substituting,  and  using  Equation  (A3-7)  again,  we  obtain 


J 


^(S)do(S)  = 


rj(J) 


.2 


Gg"|'’  (  ^(GZZ”G“)d(Z  ) 


7T 


J 


=  IGG 


H|J 

t. 


^(GSG”)d(_(S) 


It  follows  that  the  change  of  the  volume  element  of  integration  associated  with 
transformation  (A3-12)  is  given  by 

do(S)  =  |GG”l^do(S)  .  (A3-14) 

The  validity  of  Equation  (A3-7)  depends  on  the  postulated  condition  J  l  M.  If,  how¬ 
ever,  Z  is  a  J  X  M  array  with  J  >  M.  then  Z^  satisfies  the  requirements  of  the  theorem. 
We  also  have  d(Z^)  =  d(Z),  as  a  direct  consequence  of  the  definition  (Al-63)  of  Appen¬ 
dix  1.  We  therefore  obtain  the  identity 

J  5(z”Z)d(Z)  =  J  i»(S):S|^’‘‘do(S)  .  (A3-15) 


In  this  case,  of  course,  S  is  of  order  M. 
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1b  prove  the  integration  theorem  [formula  (A3-7)],  we  first  verify  its  validity  for 
the  special  case  in  which  J=l.  A  general  proof  will  then  be  established  by  induction. 
When  J  =  1,  we  write  z  instead  of  Z,  where  z  is  a  row  vector  of  M  elements.  Putting 

zz”  =  X;  Iznl^  -  S  (x^  +  yl)  s  .  (A3-16) 

m-l  m-l 


The  volume  element  of  integration  is,  of  course. 
d(z)  =  dXj...dxMdyi...dyM  . 

and  we  now  change  to  spherical  coordinates  in  the  real  space  of  2M  dimensions.  The 
radial  coordinate  is  r.  defined  in  Equation  (A3-16).  and  we  write  03^  for  the  solid  angle 
in  this  space.  We  also  write  dn2M  for  the  differential  of  this  solid  angle.  Then,  we  get 

j  5(z2^)d(z)  -- 

H 

for  the  integral  of  an  arbitrary  function  of  zz  .  The  integrand  depends  only  on  r,  and 
we  can  therefore  integrate  over  the  solid  angle,  using  the  well-known  formula 

2 

Changing  variables  again,  we  let  x  =  r  .  and  then  we  have 

00 

J S'(zz")d(z)  =  I  5f(x)x“'‘dx  .  (A3.17) 

0 

Fy*om  definition  (A3-8),  we  see  that  (M  - 1)!  =  rj(M),  and  we  also  note  that  x  corresponds 
to  S  wliich  is  a  scalar  in  this  case.  Thus.  Equation  (A3-17)  agrees  with  Equation  (A3-7), 
iiicluding  the  restriction  on  the  range  of  integration  to  non-negative  values,  for  the 
special  case  under  consideration 


/J 


5(r^)r^‘^'*drdfi 
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Tb  prove  the  general  case,  we  assume  the  validity  of  the  integration  theorem  for 
J<  M.  and  show  that  it  also  holds  when  J  is  replaced  by  J  + 1.  We  begin  by  writing 


Z  = 


V 

W 


where  W  is  a  complex  array  of  dimension  J  x  M  and  v  is  a  row  vector  of  M  complex 
components,  and  we  study  the  integral 


9 


J 


5(ZZ“)d(Z) 


(A3-18) 


We  exclude  from  this  integral  all  points  for  which  the  Z  matrix  is  not  of  full  rank.  It 
may  be  shown  that  the  measure  of  the  set  of  points  so  excluded  is  zero;  hence,  the 
integral  itself  is  not  affected.  Similarly,  all  integrals  over  the  space  of  non-negative 
definite  Hermitian  matrices  may  be  replaced  by  the  corresponding  integrals  over  the 
subset  of  positive-definite  Hermitian  matrices,  again  with  no  effect  on  the  results.  The 
latter  matrices  form  an  op  n.  dense  subset  of  the  non-negative  definites,  and  this 
subset  carries  full  measure,  which  is  an  equivalent  statement  of  our  assertion.  Since 
the  full-rank  restriction  on  Z  implies  thee  ZZ  is  always  positive  definite,  it  is  suffi¬ 
cient  to  prove  the  integration  theorem  under  these  two  restrictions  on  the  respective 
ranges  of  integration. 

The  volume  element  of  integration  in  Equation  (A3-18)  is  simply  <i(Z)  *=  d(v)d(W), 
and  we  also  have 


zz” 


vv«  vW« 
Wv”  WW“ 


The  key  to  the  proof  is  provided  by  the  form  of  the  determinant: 


|ZZ“|  =  |WW”|  [vv“-vw“(ww”)'’ Wv”|  , 


(A3-19) 


(A3-20) 


which  is  evaluated  by  an  application  of  Equation  (Al'2)  of  Appendix  1.  The  second  fac¬ 
tor  on  the  right  may  be  written 

v(Im-W“(Ww”)'*W]v“  , 
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which  shows  that  only  the  component  of  v  which  is  orthogonal  to  the  row  space  of  W 
enters  the  expression  for  this  determinant.  The  fact  that  WW^  is  non-singular  follows 
directly  from  the  non-singularity  of  ZZ^  itself. 

Fbllowing  the  procedure  first  used  in  Section  2.  we  introduce  the  J  x  M  array 

a  =  (Ww”r‘^W  .  (A3-21) 

which  serves  as  a  basis  array  in  the  J-dimensional  row  space  of  W.  The  properties 
aa*’  =  Ij 

o”a  -  W”(WW^)"'W 
W  =  (WW“)'''®a 

follow  directly.  Continuing  ai»  in  Section  2.  we  let  (8  be  an  arbitrary  basis  array,  of 
dimension  (M  -  J)  x  M,  in  the  orthogonal  complement  of  the  row  space  of  W.  so  that 

0"  =  Im-j 
=  0 

a"a  +  =  Im  . 

Then,  a  and  /S  together  form  a  unitary  matrix  of  order  M: 


Ws  apply  this  m  atrix  to  v  and  partition  the  result; 

-  I  ^'2  1  •  (A3-22) 

The  new  components  are  given  by 
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(A3-23) 


Vj^  =  va^ 

Vg  =  . 

Note  that  Vj  and  Vg  are  row  vectors,  of  dimension  J  and  M  -  J,  respectively. 
With  these  conventions  established,  we  have 


vW”  «  va”(WW”)'^  ^  Vj(WW“)‘'^  . 


U 

and  the  determinant  of  ZZ  becomes 


|ZZ”1  =  lWW“j  v(l^  -  w”(WW”)“‘w)v“ 

=  |WW“1  v(ly  -  a“a)v“  =  iww”l  VgV^ 


(A3-24) 


The  argument  of  5  can  now  be  written 


zz“  = 


y  Vj(WW”)‘^* 


(A3-25) 


where 


O  U 

y  =  ^  ^2^2 


(A3-26) 


In  the  integral  itself,  the  volurr.e  element  involves  d(v)  =  d(vj)d(v2),  since  the  Jacobian 
associated  with  transformation  (A3-22)  is  unity.  Our  integral  is  now  expressed  in  a 
form  which  depends  on  W  only  through  the  product  ww”,  and  we  can  therefore 
invoke  Equation  (A3-7)  to  transform  the  W  integral. 

This  allows  us  to  write  Equation  (A3-18)  as 


.JM 


J  = 


rj(M) 


J  #(ZZ”)|S|“-''do(S)d(v,)d(v2)  . 


(A3-27) 
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where  it  is  understood  that 


zz” 


y 

S'^v”  S 


The  integrations  over  v,  and  Vo  are  unrestricted  in  Equation  (A3*27),  but  the  integra- 

*  ^  H 

tion  over  S  is  limited  to  positive-definite  matrices.  The  determinant  of  ZZ  is.  of 
course,  given  by 


|ZZ”1  =  iSlvgvJ  . 


(A3-28) 


We  now  introduce  a  change  of  variables  by  the  linear  transformation 

vi  s  .  d(vj)  =  isr*d(u)  .  (A3-29) 

with  Jacobian  as  shown.  This  Jacobian  is  a  special  case  of  Elquation  (Al-66).  The  matrix 
ZZ^  now  assumes  the  form 


zz”  = 


y  u 
u«  S 


and  y  is  given  by 


y  =  V2V2  +  uS  'u^ 


Next,  we  define 


li 

X  S  V2V2  , 


(A3-30) 


(A3-;31) 


and  note  that  our  integral  di?pends  on  Vg  only  through  x.  Since  Vg  is  a  row  vector,  of 
M  -  J  components,  we  can  apply  Equation  (A3-7)  to  the  integration  over  Vg,  which  is  of 
the  same  kind  as  the  spec  al  case  first  evaluated  as  Equation  (A3-17).  When  this  is 
carried  out,  together  with  the  change  of  variable  from  Vj  to  u,  we  obtain 
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.JM+M-J 


dxd(u)(io(S)  . 


(A3-32) 


9  = 


V 


(M-J-l)!rj(M) 


J 


5(Zz“)(|S|x)“‘'’'‘ 


The  integration  over  u  is  unrestricted,  as  was  the  integration  over  Vj.  but  x  is  limited 
to  positive  values  by  our  application  of  Equation  (A3-7).  The  matrix  ZZ*^  is  still  given 
by  Equation  (A3-30),  with  the  understanding  that 

y  =  X  uS'^u^  .  (A3-33) 

and  its  determinant  [according  to  Elquations  (A3-28)  and  (A3-31)]  is  simply 

|ZZ“|  =  |Slx  . 

It  may  be  verified  directly  that 


and  we  therefore  have 

S  =  J  j'(ZZ”)|ZZ»|“*’'*^  dxd(u)do(S)  . 


(A3-34) 


We  make  a  final  change  of  variable,  replacing  x  by  y,  which  is  defined  in  Equa> 
tion  (A3-33).  The  only  change  in  Equation  (A3-34)  is  the  replacement  of  dx  by  dy, 
together  with  the  restriction 

y  >uS’*u“ 

on  the  range  of  integration  over  y.  But  it  is  easily  shown  that  this  condition,  together 
with  S>0  (positive  definiteness),  is  necessary  and  sufficient  to  ensure  the  positivity  of 
ZZ^.  as  defined  by  Equation  (A3-30).  This  claim  can.  in  fact,  be  verified  by  an  applica¬ 
tion  of  Equation  (Al-9)  to  an  arbitrary  quadratic  form  in  the  matrix  ZZ”. 
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According  to  definition  (A3*6),  the  volume  element  of  integration  in  Equa* 
tion  (A3-34)  can  be  expressed  as 

dyd(u)do(S)  =  do(T)  . 

where  T  is  a  (J  + 1)  x  M-dimensional  array  of  integration  variables.  Thus,  we  obtain  the 
final  result 

,7  -  J  S'{ZZ»)d(Z)  =  J  W|T|“'‘’-‘do(T)  .  (A3-35) 

and  this  completes  the  proof. 

Next  we  consider  the  multivariate  generalization  of  the  complex  central  F  distri¬ 
bution.  Let  V  and  W  be  independent  Gaussian  arrays,  both  of  which  have  mean  values 
of  zero.  Their  dimensions  are  implied  by  the  covariance  matrices 

Cov(V)=Ij®1m 
Cov(W)  = 

We  wish  to  study  the  random  array 

-^(J.M.K)  =  v”t‘‘v  ,  (A3-36) 

where 

T  E  WW”  .  (A3-37) 

The  notation  is  analogous  to  that  used  for  the  W  array  in  Section  4.  which  is  obvi¬ 
ously  given  by 

«(J.M,K)  =  Iji  +  4J.M.K)  , 

As  before,  we  assume  that  K  ^  0.  so  that  T  obeys  the  complex  Wishart  pdf.  expressed 
by  Equation  (A3-10). 
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Again  we  consider  the  expected  value  of  an  arbitrary  function  of  j4,  which  may 
be  written 


Ei?[-rf(J.M.K)]  =  4m  I  )  .  (A3-38) 


The  double  integral  signifies  integration  over  the  complex  Wishart  pdf  of  T  and  the 
complex  Gaussian  pdf  of  V,  the  latter  having  been  explicitly  introduced  in  Ekiua- 
tion  (A3-38).  Holding  the  integration  over  T  in  abeyance,  we  make  the  change  of  vari¬ 
able 


V  =  7*^2  .  d(V)  =  |Tl“d{Z)  . 

with  Jacobian  as  shown.  This  change  of  variable  is  exactly  like  the  one  given  in  i'qua- 
tion  (A3-13),  and  the  notation  is  meant  to  signify  the  positive-definite  square  root  of  T. 
Thus,  substituting  for  the  complex  Vishart  pdf.  we  obtain 


E5[4J.M.K)]  =  -  fr5(2“z)lTl**‘"’^e*'^^^‘j^^^”^’'Uo(T)d(Z)  . 

TT^“rj(J  +  K)  J  J 

We  now  reverse  the  order  of  integration,  and  also  make  the  change  of  variable 
T  s  (Ij  +  ZZ”)**''*  S  (Ij  +  Zz“r‘^  . 

The  Jacobian  .•  this  transformation,  according  to  Equation  (A3-14),  is 

do(T)  =  |Ij+ZZ”r'’do(S)  . 
and,  therefore. 


108 


JlTr"  e-i^l(i' do(T) 


=  |Ij  +  zzWl-O-M+f)  J |Sl“*'‘e'’'<‘>d<,(S)  . 

The  above  integral  is  evaluated  as  the  Wishart  normalization  factor  [see  Equa¬ 
tion  (A3-11)],  and  we  obtain 


J|^|M*K^-Tri;i,  +  2z")T;d„(T) 


rj(j+M+K) 

|Ij 


According  to  Equation  (Al-3)  of  Appendix  1. 

|Ij +ZZ“|  =  |Im-^z“2|  .  (A3-39) 

and.  hence,  we  have 


E.9[4J.M.K)] 


r  u  d(Z) 

tr-'^TjU  +  K)  J  \ly^  + 


(A3-40) 


At  this  point,  we  postulate  that  J  ^  M.  Without  this  assumption,  jrf  is  always  rank 
deficient  and  a  discussion  of  its  pdf,  although  possible,  is  more  complicated.  With  this 
assumption.  Equation  (A3-15)  may  be  applied  to  integral  (A3-40),  and  we  obtain 


e^[4J.m,k)] 


rj(j+M+K) 

rj(j+K)rM(j) 


J 


iJ-M 


m 


Hm  +  a 


,J+M+K 


do(A)  , 


(A3-41) 


where  A  is  a  matrix  of  integration  variables.  It  may  be  verified  directly  from  defini¬ 
tion  (A3-8)  that 
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rj(J+M  +  K)  -^vJ  +  M  +  K) 

rj(J+K)  ■  FmCM+k) 


and  we  may  therefore  write  Equation  (A3-41)  in  the  form 


E^[4J.M.K)] 


rw(J+M  +  K)  r  , 

r„(M+K)r„(j)  J 


(A3-42) 


We  introduce  the  definition 


Bn(b.c) 


rn(t^)rn(c) 

rn(b  +  c) 


(A3-43) 


where  n.  b.  and  c  are  all  positive  integers.  This  quantity  is  a  generalization  of  the  Beta 
function,  and  we  note  that 

B,(b.c)  =  =  B(b.c)  .  (A3.44) 

which  is  analogous  to  the  reduction  of  the  generalized  Gamma  function  when  its  sub¬ 
script  equals  unity.  The  multivariate  complex  Beta  pdf  is  now  introduced  with  the 
definition 


4(A;M.J.K) 


1 

Bm(J.K) 


iJ-M 


|Im  + AI 


J+K 


(A3-45) 


The  parameter  M  specifies  the  matrix  dimension  of  the  complex  Beta  variable  in  this 
distribution.  When  M  =  1.  the  pdf  reduces  to  the  scalar  complex  Beta  pdf,  already 
defined  by  Equation  (A2-9)  of  Appendix  2 


f*(A;l.J,K) 


1 

B(J.K) 


(1  + 


fF(A;J.K)  . 


(A3-46) 
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In  terms  of  the  multivariate  complex  Beta  pdf.  integral  (A3-42)  can  be  expressed  in 
the  form 


Ey[4J.M.K)]  =  J 


5(A)  4(A;M.J.K  +  M)do(A)  . 


A  complex  multivariate  analog  of  the  complex  Beta  random  variable  can  be 
defined  in  terms  of  jA,  still  under  the  assumption  that  J  >  M.  It  is  simply  the  inverse  of 
the  matrix  '6' 

^(J.M.K)  H  ig(J.M.K)''  =  (1^  +  .  (A3-47) 

If  A  is  a  positive  semi-definite  matrix  of  order  M,  then  R.  defined  by 

R  =  (Im  +  A)'^  .  (A3-48) 

IS  clearly  positive  definite.  In  addition,  the  eigenvalues  of  R  will  lie  in  the  range  zero 
to  unity,  hence  1^  "  R  will  be  positive  semi-definite. 

We  solve  Equation  (A3-48)  for  A: 

A  =  R'‘  -  Im  .  (A3-49) 

and  consider  the  elements  of  A  to  be  functions  of  the  elements  of  R.  Using  the 
well-known  formula  for  the  differential  of  the  inverse  of  a  matrix,  we  get 

dA  =  d(R'‘)  =  -R’^dRR'^  .  (A3-50) 

where  dA  and  dR  are  matrices  of  differentials.  We  view  Equation  (A3-49)  as  a  change 
of  variables,  and  note  that  the  relation  expressed  by  Equation  (A3-50)  is  of  the  same 
form  as  the  linear  transformation  (A3-12).  but  applied  now  to  the  differential  arrays 
dA  and  dR.  Then.  Equation  (A3-14)  provides  the  Jacobian  for  the  change  of  variable, 
and  we  can  write 

do(A)  =  iRf^^  do(R)  .  (A3-51) 

Finally,  by  expressing  A  in  the  for  m 
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A  =  R'‘(Im-R)  . 


we  can  easily  evaluate  the  required  determinants  in  formula  (A3-45)  and  supply  the 
Jacobian  from  Equation  (A3'51).  As  a  result,  we  can  write  the  expected  value  of  any 
well-behaved  function  of  in  the  form 


E5[^.(J.M,K)]  =  +  =  j5(R)fB(R;M.K  +  M.J)do(R)  .  (A3-52) 


where 


fB(R;M.K.J)  =  Hm  -  Rf*'”  (A3-53) 

is  the  complex  multivariate  Beta  probability  density  function.  The  similarity  to  the 
scalar  pdf  is  apparent,  and  when  M  =  1  it  is  complete; 

fB(R;l.K.J)  =  r’^-‘(1  -  R)'’-*  «  f^(R;K.J)  .  (A3.54) 

An  identity  is  used  in  Section  5  which  follows  directly  from  the  definition  of  the 
complex  multivariate  Beta  pdf.  Multiplying  both  sides  of  Equation  (A3-53)  by  the  n^^ 
power  of  the  determinant  of  R,  we  have 

IRT  fB(R;M.K.J)=  11m-RI^'“ 

Bw(K  +  n.J) 

=  jy  fB(R;M.K  +  n.J)  ,  (A3-55) 

and  by  direct  evaluation  we  obtain 


192 


(A3-5e) 


^  r^{K^n)r^{K^3)  ^  ji*  K^1-m 
Bm(K.J)  rM(K  +  n  +  J)rM(K)  K+j  +  n-m 

^  Yj  (KH-j)!(K-M-^n-^j)» 

(K-M  +  j)!(K  +  n+j)!  • 


Combining  these  results,  we  obtain  the  desired  identity: 


Rl"  fB(R;M,K.J)  =  fi  lB(R:M.K  +  n,J)  (A3-57) 


j  =  0 


In  Section  4.  the  GLR  test  statistic  was  defined  as 
Z(J.M.K)  =  11^^  +  v“t‘‘v1  . 

where  V  and  T  have  the  same  meanings  as  defined  here,  assuming  the  absence  of  sig¬ 
nal  components  in  the  original  data  array.  No  restriction  on  the  relative  magnitudes 
of  J  and  M  is  imposed  at  this  point.  If  9  is  now  an  arbitrary  function  of  a  scalar 
argument,  we  can  write 


Ei'f/CJ.M.K)]  =  -is  JJ^(l‘M+v”T'‘v|)f^(T;J.K|l)e''^^'''^”)do(T)d(V). 


which  is  a  particular  case  of  Equation  (A3-38)  above.  By  following  the  same  analysis 
we  used  to  derive  Equation  {A3-40),  and  recalling  also  Equation  (A3-39),  we  obtain  the 
two  equivalent  forms 


rj(j+M+K) 

5»(|Im  +  z”z|) 

d(Z) 

Tf’“rj(j+K)J 

rj(j+M  +  K) 

•t 

S'(|lj  +  zz”|) 

d(Z) 

Tr'’“rj(J  +  K)v 

|Ij  +  zz”l^''“''’^ 

(A3-58) 
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If  J  :>  M,  we  can  continue  as  before  and  apply  Equation  (A3*15),  with  the  result 


E?[/(J,M.K)]  =  J 5^(11^  +  Al)  4(A;M.J.K4M)do(A)  . 


(A3-59) 


If,  on  the  other  hand.  J  M,  we  continue  with  the  second  line  of  Equation  (A3-58)  and 
apply  the  original  integration  identity  (^uation  (A3-7)]  to  obtain 


E5f[/(J.M.K)] 


rj(J+M  +  K) 
rj(j+K)rj(M) 


|S| 


M-J 


|Ij  + 


do(S)  . 


Since 


rj(j4K)rj(M) 

rj(j+M  +  K) 


Bj(M..l  +  K)  . 


we  obtain  the  analogous  formula: 


E5[/(J.M.K)]  »  J  5(ilj  +  A|)4(A;J.M.J  +  K)do(A)  . 


(A3-60) 


Equations  (A3-59)  and  (A3-60)  represent  formal  statements  of  the  statistical  char¬ 
acter  of  the  signal-free  GLR  test  statistic,  expressed  in  terms  of  the  complex  multi¬ 
variate  F  distribution.  Later  in  this  Appendix,  this  formal  representation  will  be 
developed  to  produce  the  explicit  characterization  of  the  test  statistic  as  a  product  of 
scalar  complex  Beta  random  variables,  in  agreement  with  the  results  obtained  in  Sec¬ 
tion  4.  This  exercise  will  also  illustrate  some  useful  techniques  for  carrying  out 
explicit  integration  in  the  space  of  Hermitian  matrices 

The  integral  representation.  Equation  (A3-58).  will  now  be  used  to  prove  an 
Important  identity  concerning  members  of  the  family  of  GLR  test  statistics,  again  in 
the  signal-free  case.  Suppose  that  V  is  partitioned  as  follows; 

V  -  |v,  Vjl  , 
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where  the  dimens)on  of  Vj  is  JxMj.  Vg  is  JxMg  in  dimension,  and  Mj  +  M2  =  M.  Then,  we 
can  write 


^(J.M.K) 


Um  +  v”t‘‘vi  = 


|T  +  vv”l 
|T1 


and  we  also  have 

vv”  =  VjV”  +  VgVg  . 

These  expressions  permit  us  to  make  the  factorization 


^J.M.K)  = 


|T  + V^V”  + VgVji  |T  +  VjV”| 


|T  +  V,v“l 

Recalling  the  definition  of  T  [Elquation  (A3-37)].  we  note  that 


T  +  VjV”  =  1  W  Vjl  (  W  Vj]”  . 

which  is  another  complex  Wishart  matrix,  of  the  same  dimension  J,  but  with  J  +  K  +  Mj 
degrees  of  freedom.  Thus,  we  can  write 


|T  +  VjV 


H 


VjV»| 


|T  + VjV" 


I'm,  +  ''»(T 


VjVf)‘W2|  =  /(J.M2.K  +  M,)  ,  (A3-61) 


and  also 


=  1Im,  +  V»T'Vi!  =  ^(J.Mj.K)  .  (A3-62) 

The  notation  on  the  right  sides  of  these  equations  has  been  introduced  as  a  way  of 
indicating  the  statistical  character  of  the  quaritities  involved. 

We  have  shown  that 

/(J.M.K)  =  ^(J,Mg,K  +  M,) /(J.Mj.K)  .  (A3-63) 
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and  we  now  wish  to  prove  that  the  factors  on  the  right  are  statistically  independent. 
Equation  (A3-63)  is  therefore  analogous  to  the  representation  of  the  GLR  statistic  as  a 
product  of  independent  factors,  as  given  by  Equation  (4-31)  of  Section  4.  By  choosing 
Mj  =  1,  and  then  iterating  this  identity,  we  can  obtain  from  Equation  (A3-63)  the  rep¬ 
resentation 


M-i 

^(J,M,K)  =  n  f(J,l,K  +  m)  ,  (A3-64) 

m=0 

which  is  directly  analogous  to  Equation  (4-32).  The  factors  in  this  product  are  inde¬ 
pendent,  and  from  this  representation  we  can  again  obtain  the  double-product  form. 
Equation  (4-36). 

To  prove  the  independence  of  the  factors  in  Equation  (A3-63),  we  let  9  be  an 
arbitrary  function  of  two  scalar  arguments  and  consider  the  expectation  value 

■ 


where 


=  ^(J.Mg.K^Mj) 

s  ^(J,Mj,K)  .  (A3-65) 

This  notation  is  adopted  for  brevity,  and  the  variables  on  the  right  sides  of  these  def¬ 
initions  are  given  explicitly  in  Equations  (A3-61)  and  (A3-62),  respectively.  Since  Vj  and 
Vg  are  independent  complex  Gaussian  arrays,  we  can  write 

JJJ  +  (A3-66) 


The  proof  is  carried  out  by  means  of  a  sequence  of  linear  transformations, 
applied  to  the  variables  of  integration.  The  first  transformation,  together  with  its 
Jacobian,  is  given  by 

Vg  =  (T-t  ViV[*)^Z^  .  d(V2)  =  |T  +  ViV”|“2d(Zj  . 

!n  terms  of  Z^,  we  have  [recalling  Equation  (A3-61)] 
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-  I'kj  +  zXi  =  lij+vJl . 

while  is  unaffected.  We  carry  out  this  transformation,  and  also  substitute  for  the 
complex  Wishart  pdf  in  Equation  (A3-66),  with  the  result 

-jmT'.T",.'  rffj((..'l.)|T|'‘|T  +  V,V«|“e 

Tf  rj(j4-K)  J  J  J 

^  e'''''^'’‘^'^>''“^^‘j'*’^^*^do(T)d(V^)d(Z^)  .  (A3-67) 

Next,  we  carry  out  the  simultaneous  transformations 

Vj  s  (lj  +  Z,Z»)-'^V, 

T  s  (Ij  +  Z^z”)-'^f  (Ij-^Z^ZJ)-'^  . 

The  corresponding  Jacobians  are  expressed  by  the  equations 
d(Vj)  =  iij+z^z”r«‘d(Vi) 

do(T)  =  |lj  +  Z^z”r''do(f)  . 

and  we  note  that  is  unchanged  in  form: 

We  make  the  evaluations 

'IV(T  +  ViV»)(lj  +  Z,z")  =  'IV{Ij  +  Z.Z”)'^(T  +  V,V»)(lj  +  Z^z”)'^ 

=  Tr(f  +VjVf)  . 

and 
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|T|'^|T  +  VjV[*|“2  =  +  |f  1*^  |f  +  VjV“l“2  . 

and  substitute  in  the  integrand  of  Equation  (A3-67).  with  the  result 


+  VjVf|“2 


X  e 


- Tr (f  +  )d(^i)d(2^) 


(A3-68) 


The  last  step  of  the  proof  is  similar  to  our  previous  analysis  of  the  pdf  of  the  j4 
matrix.  We  let 

V,  =  f '^Zb  .  d(Vi)  =  |f|“‘d(Zb)  . 

and  note  that  now 

'b  =  l'M,  +  zSZbl  =  l>j  +  vSl 


and 


!f +v,v"|  =  lf||ij  +  ZbZ“| . 

With  these  changes  of  variable,  integral  (A3-68)  becomes 


1 

7t''“rj(j+K) 


«o(T)d(Zb)d(Z.) 


(A3-69) 
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In  order  to  simplify  the  notation,  we  have  dropped  the  tilde  from  the  matrix  of  inte¬ 
gration  variables.  The  integration  over  T  is  carried  out  as  before; 


I 


rj(j+M+K) 


We  are  left  with  the  double  integral 


rj(j+M  +  K) 
TT^“rj(j+K) 


■>  p 


d(ZJ 


d(Zj 


HJ+M+K 


By  an  obvious  factoring  of  the  expression  which  precedes  the  integral  in  this  formula, 
we  can  write  it  in  the  form 


rj(J^M  +  K)  d(Z^) 

n’'^2rj(J  +  Mi  +  K)  llj  +  Z^z“|''^“''’^ 


rj(J  +  M,  +  K)  d(Zb) 


TT''W‘rj(j+K)  iij  +  ZbZ”r“«" 


H,J+M,+K 


(A3-70) 


Comparison  with  Equation  (A3-58)  shows  that  the  proof  is  complete,  and  that  and 
are  indeed  independent  random  variables. 

In  Section  4,  under  the  assumption  that  no  signal  components  are  present  in  the 
data  array,  it  was  shown  that  the  inverse  of  the  GLR  test  statistic  can  be  expressed 
as  a  product  of  independent  random  variables,  each  of  which  obeys  a  Beta  distribu¬ 
tion.  This  result  will  now  be  obtained  independently,  using  the  methods  of  this  Appen¬ 
dix.  starting  with  one  of  the  formal  integral  representations  derived  above.  We  assume 
that  J^M,  in  which  case  Equation  (A3-60)  will  be  our  starting  point.  A  similar  deriva¬ 
tion,  proceeding  from  Equation  (A3-59).  would  apply  in  the  case  where  J  >  M. 

We  begin  by  partitioning  the  A  matrix,  as  follows; 


A  s 


y 


u 


u 

B 


(A3-71) 
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where  y  is  a  scalar,  and  B  is  a  square  matrix  of  order  J  - 1.  Since  A  is  positive  definite 
over  the  range  of  integration,  the  new  variables  are  subject  to  the  restrictions 

B>0 

y>uB'^u"  . 

We  have  noted  these  conditions  before,  and  we  make  the  change  of  variable 

y  s  X  +  uB‘’u^‘  (A3-72) 

I 

to  facilitate  the  application  of  this  constraint.  It  is  only  necessary  to  require  that 
x>0,  and  the  integration  over  u  is  completely  unconstrained.  It  is  permissible,  there¬ 
fore.  to  put 

do(A)  =  dxd(u)do(B) 

I 

I 

in  Elquation  (A3-60).  We  also  compute 
|A1  =  |B|x 

and,  dropping  the  subscripts  on  the  identity  matrices  now.  we  have 
|I  4-  A|  -  11  +  B|[l  +  X  +uB'^u”-u(I  +  B)'*u“]  . 

We  define  the  matrix  Q  by  means  of  the  equation 
Q-i  s  B'‘  -  (I  +  B)’‘  =  B’‘(I  +  B)"^  . 
from  which  it  follows  that 
Q  =  (I  +  B)B  . 

We  introduce  t:.e  new  variable  v  by  means  of  the  definition 

and  recall  that  u  is  a  row  vector  of  J  - 1  elements.  It  follows  that 
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d(u)  =  x''-^|Q|d(v)  =  +  B|d(v) 


and  also  that 

II  +  A|  =  II  +  B![  1  +  x(l  +  vv“)]  . 

Making  the  appropriate  substitutions  in  Equation  (A3-60).  we  obtain 


(A3-73) 


IB 


II  ^  B 


iJ+M+K-l 

I 


M-1 


1  +  x(l  -t-  VV^) 


h'U^m.k  <io(B)dxd(v) 


(A3-74) 


The  integration  over  x  in  this  multiple  integral  is  confined  to  positive  values  and.  in 
the  argument  of  9,  it  is  understood  that  Equation  (A3-73)  is  to  be  applied. 

Next  we  replace  x  by  a  new  variable  p,  by  means  of  the  definition 
1  +  x(l  +  vv*^)  =  p'*  . 

Obviously,  we  will  have  0  <  p  <  1,  and  also 
|dx|  =  (1  +  vv^)  ^|dp/p^|  . 


We  can  therefore  write 


+  A|  =  II  +  B|p'*  . 


and  make  the  evaluation 


.M-l 


1  +  X(1  H-  VV^) 


J+M  +  K 


J+K-1  /I  _ 

dxd(v)  = - - — dpd(v) 

(1  +  vv”)^’ 
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An  application  of  Equation  (A3»17),  together  with  the  normalization  integral  of  the 
scalar  complex  F  distribution  [Equation  (A2-9)].  yields  the  evaluation 


J 


d(v) 


-sil  f 

0 


(1  +  vv»)" 


rt,  -  ,J-1 
df  =  7T  - - 

(1  +  ^)”  (M-1)! 


and,  therefore,  we  have 


E5t[^(J,M,K)]  = 


(M-l)!Bj(M.J  +  K) 


|B^ 


-J+l 


II  +  B1 


J+M+K-] 


Recalling  the  scalar  complex  Beta  pdf  [Equation  (A2-12)],  we  can  write 

M-.,  ^  (J;k-i)i(m-iv  ,  (  y) 

(J  +  M  +  K-1)!  P 


and  it  is  easily  verified  that 

(J  +  M  +  K-1)'B[(M,J+K) 


7t''‘‘(M-J)!(J+K-1)! 


=  Bj.i(M.J+K-l) 


We  therefore  find  that  Equation  (A3*75)  can  be  written 


r  r  r  i  r 

Bj.i(M,J+K-l)  J  L  J  ^  II  + 


U  +  er 


X  f^(p;J+K,M)dp  , 


and,  by  iteration,  it  follows  that 


(A3-75) 


7  cio(B) 
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(A3-76) 


^[(Pi  -  Pj)"’]  f(Pi  ..pj)dpi...dpj  , 


where 


J 

f(Pl  Pj)  =  n  VPj;K+j.M)  (A3-77) 

j  =  l 

In  the  final  step  in  this  iteration,  the  scalar  complex  F  distribution  appears  and  is 
easily  transformed  to  an  integral  over  the  scalar  complex  Beta  density,  with  the 
result  as  stated  above.  Equation  (A3-76)  is  equivalent  to  Equation  (4-33)  of  Section  4, 
and  with  this  observation  the  proof  is  complete. 
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APPENDIX  4 

AN  ALTERNATIVE  DERIVATION  OF  THE  GLR  TEST 


In  this  Appendix  we  provide  an  alternate  derivation  of  the  GLR  test,  which  is 
particularly  appropriate  for  the  signal  model  described  by  Equation  (1-4).  We  return  to 
Equation  (2-25),  as  a  starting  point,  and  write  it  in  the  form 


Min  F(b)  ’ 
b 

where  ar  in  Section  2, 

F(b)  =  {Z-ebp)(Z-ebp)”  . 

Recall  the  arrays  e  and  f.  introduced  in  that  section,  and  also  the  unitary  matrix 
-  1  e  f  i  . 

We  now  introduce  a  decomposition  of  the  data  array  Z,  by  means  of  the  defini¬ 
tion 


ujjz 


[Xa 

IXb 


or.  equivalently, 


X,  .  e"Z 


Xb  • 


In  terms  of  the  components  defined  in  Section  2,  we  note  that 

XA^r  -  iza  "aI 

XbL'I;  =  IZ3  Wgj  , 


(A4-1) 


(A4-2) 


(A4-3) 


205 


The  new  components  are  brought  into  the  analysis  by  means  of  the  definition 

F(b)  s  uj3F(b)U^  . 

and  the  observation  that 

Min  |F(b)l  =  Min  IF(b)i  . 
b  b 

Substituting  for  and  F(b),  we  obtain 

(X,  -  bp){Xj,  -  bp)”  (Xa  -  bp)xg  ■ 

F(b)  =  .  (A4-4) 

Xb(X;,  -  bp)”  XgX” 

The  required  determinant  is  evaluated  using  identity  (Al-2): 
iF(b)i  3  iXgxSi  ij(b): . 

where 

J(b)  =  (Xa  -  bp)(X^  -  bp)”  -  (X^  -  bp)  xJCXgXg)'’  Xg  (X^  -  bp)”  . 

|U 

Since  XgXg  satisfies  a  complex  Wishart  distribution  of  dimension  N-J,  with  L 
complex  degrees  of  freedom,  its  inverse  exists  with  probability  one  as  a  result  of  our 
assumption  in  Equation  (1-9).  Vfe  restrict  the  present  analysis  to  the  case  J<  N. 

In  terms  of  the  matrix 

R  ^  1l  -  xgCXgX”)'*  Xg  ,  (A4-5) 

we  have 

J(b)  =  (X^  -  bp)R(XA  -  bp)” 

=  bpRp”b”  -  bpRxJJ  -  X^  Rp”b”  +  X^RX”  (A4-6) 
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Since  i.he  dimension  of  Xg  is  (N  -  J)x  L.  we  can  compute  the  trace  of  R  as  follows: 


TV(R)=  L-  TV[xg(XBXg)*‘XB] 

=  L  -  MCXeXgr^XgXg)] 

=  L+J'N . 

Since  R  is  obviously  idempotent,  its  eigenvalues  are  either  zero  or  unity,  and  the  trace 
evaluation  shows  that  N  -  J  of  them  must  vanish.  Thus,  R  is  a  projection  matrix  and 
singular,  except  in  the  special  case  J  =  N.  However,  the  matrix  pRp*^  is  positive  definite 
(with  probability  one),  as  will  now  be  shown. 

Fhom  Equations  (A4-3)  and  the  definition  of  U^.  we  have 
Xbp”  =  Zb 

and  also 


XgXg  =  ZpZg  -  WgW'g 
It  follows  that 

pRp"  =  1„  -  zg(ZBZg  +Wb'''b)'‘  Zb  •  (^“-7) 

and  the  existence  of  the  inverse  in  this  formula  has  already  been  noted.  But  the  right 
side  of  Equation  (A4-7)  is  itself  just  the  inverse  of  the  matrix  defined  by  Equa* 
tion  (3-14).  which  we  know  to  be  positive  definite,  ar  d  this  completes  the  proof. 

We  can  therefore  define 

b  s  X;^Rp”  (pRp“)''  =  X^Rp^C^,  .  (A4-8) 

and  complete  the  square  in  Equation  (/.4-6)  The  resr.ll  is 

J(b)  =  (b  -b)pRp"(b  -b)”  +  X^RX”  -  b  pRp”  b“  . 

The  use  of  iaentity  (3-30)  then  yields 
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Min  iJ(b)l  =  lJ(b)|  , 
b 


provided  only  that 

J(b)  =  XJR  -  Rp"(pRp”r‘pR]x!; 


is  a  positive-definite  matrix,  as  will  be  shown  below.  Since  the  numerator  of  the  test 
statistic  is  the  determinant  of  F(0).  we  easily  obtain  the  desired  result 


140)1  ^  IXaRx^I 


(A4-9) 


where 


Q  E  R  -  Rp”(pRp”)'‘ pR  .  (A4-10) 

An  efficient  algorithm  for  carrying  out  this  computation  with  actual  data  can  be 
devised,  using  the  techniques  which  are  described  in  Appendix  6. 

It  nteresting  to  evaluate  the  performance  of  the  test,  as  expressed  in  the  form 
just  derived.  We  assume  that  the  true  signal  parameter  array  is  B  and  that  the 
covariance  matrix  of  the  columns  of  the  data  array  is  E.  Taking  the  expected  values 
of  both  sides  of  Equations  (A4*2),  we  obtain 

E  X^  =  bp 
E  Xb  =  0  . 

The  array  b  which  appears  in  the  first  of  these  formulas,  is  given  in  terms  of  B  by 
Equation  (2-23).  These  component  arrays  have  independent  columns,  but  they  are,  of 
course,  correlated  with  one  another. 

It  is  expedient  to  carry  out  the  whitening  operation  at  this  point,  rather  than  at 
a  later  stage,  as  was  the  case  in  the  analysis  of  Section  3  First,  however,  we  eliminate 
the  correlation  between  Xj^  and  Xg  by  writing  the  former  array  as  the  sum  of  its 
conditional  expectation  given  Xb  (i.e..  the  linear  predictor)  and  a  "remainder"  term 
(the  prediction  error): 
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^A 


The  remainder  term  is  Gaussian  and  independent  of  Xg.  and  it  is  characterized  by  the 
relations 


EX^  =  bp 

Cov(Xa)  =  ©1l  . 

The  K  matrix  is  a  projection  onto  the  subspace  orthogonal  to  the  span  of  the  the  col¬ 
umns  of  Xg.  and  it  is  obvious  from  its  definition  that  XgR  =  0.  Therefore,  we  can  sim¬ 
ply  replace  X^^  by  the  remainder  term  in  the  numerator  of  the  test  statistic.  Because 
of  the  form  of  Q,  the  same  is  true  of  the  denominator;  hence,  we  have 


«w  ^14 

IX.QXj: 


(A4-11) 


Whitened  arrays  can  now  be  introduced,  as  follows 
Xao  ^ 

Xbo  ~  (^BB^  *^Xb  .  (A4-12) 

These  Gaussian  arrays  are  independent  and  are  characterized  by  the  equations 


EX^o  =  (E^^^bp 
EXbo  =  0 
‘^ov(Xao)  =  Ij®1l 

Cov(XBg)  =  •  (A4-13) 

In  terms  of  these  quantities,  we  have 
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I 


(A4-14) 


|)<aoRXaoI 
IXaoUXmI  ’ 


since  the  determinants  of  the  whitening  matrices  will  cancel  out.  Moreover,  the  R 
matrix  is  unchanged  in  form  as  a  result  of  this  transformation; 


R  = 


^BO^^BO^BO^  '  ^BO  • 


(A4-15) 


It  still  remains  to  be  proved  that  the  matrix  whose  determinant  forms  the  denomi¬ 
nator  of  the  test  statistic  is  positive  definite. 

At  this  point,  we  simplify  the  notation  by  dropping  the  tilde  and  the  subscript  0. 
Then,  the  test  statistic  is  again  given  by  the  right  side  of  Equation  (A4-9).  but  the 
and  Xg  arrays  now  have  the  properties  given  by  Equations  (A4-13).  Tbrning  to  the  R 
matrix,  we  follow  the  pattern  established  in  Section  3  by  introducing  the  array 

n  ^  (XgXgr'^XB  .  (A4-16) 

u 

assuming  that  the  positive-definite  square  root  of  the  matrix  XgXg  has  been  chosen. 
The  basic  properties 

=  In-j 

T7*^rj  =  Xb(XbXb)  ^  Xg 
Xb  =  (XBXg)'^T; 


then  follow  as  before.  The  r)  array  forms  a  basis  for  the  row  space  of  Xg.  A  basis 
array  6  is  chosen  in  the  orthogonal  complement  of  this  subspace  which,  together  with 
7),  forms  a  basis  for  (11^  itself.  We  then  have 

oe"  =  'uj-N 

erj”  =  0 

7;“  7,  +  e^e  =  1l 
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A  unitary  matrix  is  formed  from  these  basis  arrays,  as  follows 


and  it  is  used  to  perform  a  rotation  and  partitioning  of  the  array  X^: 

The  new  components  are,  of  course,  also  given  by  the  equations 

+1  -  XaS" 

*2  -  XaI" 

The  R  matrix  finds  a  simple  expression  in  terms  of  these  arrays,  namely. 

R  =  =  e”®  .  (A4-18) 

and  we  also  have 

Q  =  P  0  . 


where 


P  ^  Il^j-n  -  ep”(p0”0p»r'p0”  . 
The  GLR  test  statistic  can  now  be  written 


(A4-19) 


(A4-20) 


Note  that  only  the  first  of  the  two  components  of  Xy^.  introduced  in  Equation  (A4-17), 
has  survived  in  this  formula  Next,  we  define  the  array 


s  p0 


(A4-21) 


211 


since  this  combination  appears  in  the  matrix  P.  which  describes  another  projection: 


P  =  1l+J-n  “ 

The  expected  value  of  'I'j  can  also  be  expressed  in  terms  of 
E'l'j  =  (E^^)'^bAi  . 

lb  deal  with  the  decomposition  imposed  by  P.  we  define  the  basis  array 

y  s  .  (A4-22) 

in  direct  analogy  to  previous  derivations  Then,  we  have 

=  Im 

M  =  (M/i  ;  y 

The  y  array  forms  a  basis  of  the  (L  + J -N)-dimensional  row  space  of  and  the 
orthogonal  complement  of  this  space  is  given  a  basis  array  which  we  will  call  6.  Then, 

“  ^L+J-N-M 

<57”  -  0 

y^y  +  <5”a  =  Il+j-n  (a4-23) 

Continuing  in  the  usual  way,  we  form  the  unitary  matrix 


^L+J-N  =  ^  • 

and  then  decompose  4'j: 

'^'l^L+J-N  -  IV'l  V'2!  • 


(A4-24) 


(A4-25) 
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Individually,  these  cor.iponenls  are  given  by  the  equations 


=  'I'j 

■ 

Since  the  expected  value  of  can  be  written 

we  compute 

E^l  = 

Ei^2  =  0  ■ 

Working  back  through  the  definitions,  we  find  that 
=  pRp  =  C,^  . 
and.  consequently. 

=  (E^^)'^bC-J^  =  Vo,  . 

The  "signal  array"  Vqj  was  defined  in  Equation  (3-37)  of  Section  3 

Fhom  definition  (A4-26)  and  the  last  of  Equations  (A4-23).  we  obtain 

=  V'lV'"  +  V'eV'g 

and 

P  =  6^6  . 

These  results,  in  turn,  lead  to  the  simple  form 


(A4-26) 


(A4-27) 
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L 


(A4-28) 


iV'z  V'?! 

Since  "Vi's  is  a  zero-mean  Gaussian  array,  with  covariance  equal  to  the  identity  and 
dimension  J  x  (L  +  J  -  N  -  M),  the  matrix  in  the  denominator  obeys  a  Wishart  distribu¬ 
tion  with  sufficient  degrees  of  freedom  to  assure  its  positivity,  hence  this  property  is 
finally  established. 

The  dimension  of  the  array  V*!  is  JxM  and  its  covariance  matrix  is  the  identity. 
Since  its  mean  is  Vq^,  it  is  statistically  identical  to  Vq  introduced  in  Section  3.  In 
addition,  the  matrix  V'aV'z  is  statistically  identical  to  Tq  of  that  section,  hence  we 
write 


=  Vq 

=  To  . 

and  obtain,  for  the  GLR  test  statistic; 


IVovg  TqI 

ITol 


(A4-29) 


FVom  the  determinant  identity  (Al-2),  we  see  that  this  expression  is  identical  to  for¬ 
mula  (3-41)  for  the  GLR  test,  hence  the  two  approaches  are  entirely  equivalent. 
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APPENDIX  5 

THE  CONSTRAINT  ON  THE  DIMENSIONAL  PARAMETERS 


The  general  decision  problem  discussed  in  the  main  body  of  this  report  is  char¬ 
acterized,  in  part,  by  the  four  dimensional  parameters  N.  L.  J,  and  M.  The  original  data 
array  is  NxL  and  the  signal  parameter  array  is  JxM  in  dimension.  We  pointed  out  in 
Section  1  that  these  parameters  are  constrained  by  the  condition  L  ^  N  +  M.  if  we  are 
to  have  a  meaningful  GLR  test.  The  condition  was  used  at  several  points  in  the  analy¬ 
sis.  always  to  en.^ure  that  some  matrix  was  positive  definite,  and  its  sufficiency  has 
therefore  been  established.  We  claimed  that  the  constraint  is  also  necessary,  and  that 
property  is  proved  here  This  fact  is  of  importance  only  because  it  affects  the  applica¬ 
bility  of  the  model  itself. 

As  shown  in  Section  2.  the  GLR  test  statistic  is 

;  =  I2z”i 

Min  F(b) 
b 


where 


F(b)  H  (eb  -  Zp)(eb  -  Zp)”  +  S 
S  s  ZqZj  . 

The  notation  is  that  of  Sections  2  and  3.  We  now  assume  that  L<  N  +  M  and  show  that 
b  can  be  chosen  to  make  F(b)  singular,  in  which  case  the  GLR  test  statistic  will  not 
exist.  The  proof  will  be  probabilistic,  and  it  will  actually  be  shown  that  an  array  b  can 
be  found  with  probablity  one  We  introduce  the  "whitened”  arrays 


7  =  y-Vi  7 

^qO  -  ^  \ 

Zpo  = 

eo  =  , 

(A5-1) 

and  consider  the  matrix 
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Fo(b)  =  (eob  -  Zpo)(eob  -  Zpo)”  +  Sq  . 


(A5-2) 


where 


<5  _  7  7H  (A5*3) 

^0  =  ^qO^cjO  • 

Since 

Fo(b)  -  F(b)  , 

it  will  suffice  to  show  that  Fo(b)  can  be  made  singular  by  an  appropriate  choice  of  b. 

Since  the  NxN  matrix  Sq  is  composed  of  L-M  dyads,  formed  from  the  columns 
of  ZqQ.  it  'Will  be  rank  deficient  under  our  assumption.  For  a  given  data  array  Z,  let  v 
be  a  vector  in  the  null  s  pace  of  Sg.  so  that 


V^SgV  =  0 


(A5-4) 


We  must  now  find  an  array  b.  for  which 

v”Fo(b)v  =  0,  (A5*5) 

in  order  to  show  that  Fg^b)  is  singular.  Obviously.  Equations  (A5-4)  and  (A5*5)  together 
imply  that 

(cgb  -  Zpo)  =  0  . 


or. 


v^egb  =  v“Zpo  . 

We  must  show  that  these  equations  can 
one. 


(A5-6) 

be  solved  for  the  b  array,  with  probability 


We  can  express  the  JxM  array  b  in  the  form 


b  =  [b,.  ...bMl  . 
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where  each  is  a  J  vector.  We  can  also  write 
''"Zpo-  [f, . «m1. 

u 

where  the  are  simply  scalars.  Finally,  we  note  that  v  Cq  is  a  row  vector  of  J  ele¬ 
ments.  Equations  (A5-6)  can  therefore  be  written 

v“eob^  =  .  l<m<M  (A5-7) 

If  v^Cq  has  at  least  one  non-vanishing  component,  then  the  b  array  can  be  chosen  (in 
many  ways)  to  make  FQ(b)  singular.  The  procedure  fails  only  if  v  is  orthogonal  to 
every  column  of  Bq,  and  this  must  be  true  for  every  v  in  the  null  space  of  Sq.  Equiv¬ 
alently.  each  column  of  Bq  must  be  orthogonal  to  the  null  space  of  Sq.  There  is  noth¬ 
ing  special  about  the  columns  of  Cq,  and  we  now  propose  to  show  that  for  any  fixed 
unit  vector  in  <C  ,  say  A,  the  probability  that  A  is  orthogonal  to  the  null  space  of  Sq  is 
zero,  and  with  this  our  proof  will  be  completed 

Let  Pq  be  a  projection  matrix  which  projects  onto  the  column  space  of  Z^q.  Then, 
If^,  -  Pq  projects  onto  the  null  space  of  Sq.  and  for  A  to  be  orthogonal  to  this  null  space 
we  must  have 

a”(I^.  -  Po)A  =  0  . 


or. 


u  s  1  -  A^PqA  =  0  . 

The  projector  Pq  is  constructed  directly  from  Z^q,  as  follows: 

Po  =  Z,(,(2jz,o)-‘z;o  .  (A5-8) 

As  a  result  of  our  whitening,  the  array  Z^q  is  Gaussian,  with  zero  mean,  and  with 
independent  elements.  It  is  also  circular,  which  in  this  case  means  that  the  real  and 
imaginary  parts  of  its  elements  are  all  independent.  Then, 


is  a  Gaussian  array,  with  identical  properties;  hence. 
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''  v"  =  z3dZ,o 

obeys  a  complex  Wishart  distribution,  of  dimension  L-M,  with  N  complex  degrees  of 
freedom.  Therefore,  the  inverse  indicated  in  Equation  {A5-8)  exists  with  probability 
one. 

In  terms  of  V,  we  have 

U  =  1  -  a“v”(Vv”)*Wa  .  (A5-9) 

The  unit  vector  A  defines  a  subspace  of  and  we  introduce  a  basis  array,  say  D,  in 
its  orthogonal  complement.  Then. 

Uo  =  [  A  D  ] 

is  a  unitary  matrix,  and  we  write 

vUo  =  IV,  Vjl  . 

where 

Vj  s  VA 
Vg  ^  VD  . 

We  also  have 

V  •-  VjVj^  +  ^^2^2 

The  array  V2  is  just  like  V.  except  that  its  dimension  is  (L  -  M)  x  (N  - 1),  Since,  by  our 
assumption. 


N-1  >  L-M  , 

JJ 

the  Wishart  matrix  VgVg  is  also  positive  definite  with  probability  one.  We  can  now 
express  u  in  the  form 
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u  =  1.  -  +  V2V")-^V, 

=  [l  ^  V»(V2V«)-‘vJ’'  . 


(A5-10) 


where  the  Woodbury  identity  [Equation  (a1-5)]  has  been  utilized. 

The  fornn  found  above  for  the  random  variable  u  is  exactly  like  the  inverse  of 
the  test  statistic  in  the  absence  of  signals,  for  the  special  case  M  =  1  discussed  in  Sec¬ 
tion  4.  It  was  shown  there  that  this  random  variable  is  subject  to  a  Beta  distribution: 
hence,  u  assumes  the  value  zero  (or  any  other  discrete  value)  with  probability  zero, 
and  this  compleLes  our  proof. 
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APPENDIX  6 

NUMERICAL  COMPUTATION  OF  THE  FALSE  ALARM  PROBABILITY 


In  Section  4  it  was  shown  that  the  GLR  test  statistic  can  be  expressed  as  a  prod¬ 
uct  of  independent  random  variables,  in  the  case  when  no  signal  components  are 
present.  The  probability  distribution  function  of  this  product  provides  the  PFA  of  the 
test  as  a  function  of  the  threshold.  The  product  representation  derived  in  Section  4  is 


1/^ 


J  M 

n  n  • 

1=  1  m=  1 


(A6-1) 


where  x^(n,l)  is  subject  to  the  Beta  distribution; 
f^(x;n,l)  =  n x"*'  . 

It  is  understood  that  the  factors  in  Equation  (A6*l)  are  all  independent,  and  the  nota¬ 
tion  signifies  the  statistical  character  of  each  factor. 

We  introduce  the  logarithm  of  the  GLR  test  statistic: 

X  s  logf  . 

and  the  generating  function: 

4>(z)  s  Ef"  -  ,  (A6-2) 

which  will  be  evaluated  later.  4>(iu)  is  the  characteristic  function  of  the  random  vari¬ 
able  and  the  pdf  of  X  is  therefore 


f(X)  = 


oo 

^  J  e‘‘“^  ♦(iu)du 

-  OO 


loo 

=  sir,  fWdz 

*  :  oo 


(A6-3) 
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If  XQ  =  \og  Iq,  the  PFA  of  the  test  will  be 


PFA  =  Prob(/  >  ^0 )  ~ 


J  f(X)ciX  . 
^0 


(A6-4) 


We  substitute  Equation  (A6-3)  into  Equation  (A6-4)  and  shift  the  contour  of  integra¬ 
tion  over  z  to  the  right  of  the  imaginary  axis  by  a  small  amount  fx.  This  permits  an 
interchange  of  the  order  of  integration  and  the  evaluation 


ioo-f/i 


PFA  = 


L  J  e-V»(,)d_z 


-  1  00  +  ^1 
ioo-*-  fi 


-  1  00  +  /X 


(A6-5) 


To  evaluate  4(z).  we  first  compute 
1 

J  x'*  f^(x;n.l)dx  =  ^ 
0 


and  then,  from  definition  (A6-2).  we  obtain 


'  n  n 

j=  I  m  =  1  •' 


K-H  +  m-1 
+  m-l-z 


(A6-6) 


The  poles  of  this  function  are  all  on  the  real  axis  between  x=K+l  and  x=K  +  J  +  M-l. 
The  extreme  poles  are  simple,  but  the  others  have  varying  multiplicities,  and  this 
makes  an  evaluation  by  means  of  the  residue  series  quite  awkward.  We  note  that  ♦(z) 
is  analytic  over  the  entire  z-plane,  with  the  exception  of  the  poles,  and,  in  particular, 
it  is  analytic  in  the  strip 

0  <  x<  K  +  1  , 
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(where  z  =  x  +  iy),  hence  may  have  any  value  in  this  range.  Since 


[4>(2)]*  =  4»(z‘)  . 

the  integral  in  Equation  (AC-5)  over  the  portion  of  the  contour  in  the  lower  half  plane 
is  the  negative  of  the  complex  conjugate  of  the  integral  over  the  upper  portion  and, 
therefore, 


ioo  +  fi 

PFA  =  J 


(A6-7) 


The  contour  for  this  integral  may  be  deformed  so  that  it  passes  to  infinity  anywhere 
in  the  first  quadrant,  as  long  as  the  poles  are  avoided. 

We  now  show  that  /z  and  the  contour  can  be  chosen  in  a  way  which  makes  the 
integral  converge  rapidly,  while  the  integrand  remains  positive  and  monotonically 
decreasing.  By  following  this  contour,  the  integral  can  be  efficiently  evaluated  by 
numerical  integration.  Our  procedure  follows  closely  the  work  of  Helstrom.  especially 
the  technique  used  in  Reference  c2. 

•1  X 

We  observe  that  the  funciion  x  a  is  convex,  for  real  positive  values  of  a  and  x: 

=  [(loga-if S  0 
dx  ^  X 

Putting  a=1/Iq  and  taking  the  expected  value  of  both  sides  of  this  equation,  we 
obtain 

>  0  (A6-8) 

dx  dx 


For  values  of  z  on  the  real  axis  between  zero  and  K  +  l,  the  integrand  of  Equa¬ 
tion  (A6-7)  is  real  and  positive,  and  Equation  (A6-8)  shows  that  it  is  also  convex. 

The  integrand  has  poles  at  the  ends  of  this  interval,  and  it  must  therefore  have  a 
single  minimum  at  some  interior  point.  We  choose  this  point  for  /i.  and  discuss  later 
the  procedure  for  finding  it.  We  also  define  the  function 


^(z)  =  log[z'‘^o'^  ♦(z)]  , 


(A6-9) 
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so  that  Equation  (A6-7)  may  be  written 


loo  +  M 

PFA  =  ^  J  exp[+(z)]dz  .  (A6-10) 

M 

The  derivative  d^'(x)/dx  obviously  vanishes  at  x=^,  hence  d4'(z)/d2=0  at  2=/x  since  ^ 
is  an  analytic  function  of  z.  Therefore,  the  real  and  imaginary  parts  of  4',  being  solu* 
lions  of  Laplace's  equation,  both  exhibit  saddle  points  at  z  =  /z.  The  imaginary  part  of 
4'  is  zero  on  the  real  axis;  hence,  another  contour  on  which  Im(4')  -  0  must  cross  the 
real  axis  at  x  =  /:x.  in  a  direction  parallel  to  the  imaginary  axis.  These  contours,  on 
which  the  imaginary  part  of  4^  is  zero,  are  contours  of  steepest  descent  or  ascent  of 
the  real  part  of  4^  which  pass  through  its  saddle  point.  We  know  that  the  real  part 
increases  away  from  x=  /Li  on  the  real  axis;  therefore,  the  other  contour,  crossing  the 
axis  of  reals  at  right  angles,  is  the  one  along  which  the  real  part  of  4'  descends  most 
rapidly  from  its  value  at  z  =  fu. 

By  choosing  the  portion  of  this  contour  which  lies  in  the  upper  half-plane  for  our 
integral,  we  ere  assured  of  rapid  convergence.  Since  the  integrand  is  real  and  mono- 
tonically  decreasing  on  the  contour,  we  are  also  assured  of  numerical  stability  when 
the  integral  is  carried  out  numerically.  Fbr  large  values  of  |zl.  4'(2)  is  dominated  by  the 
term 


4'(z)  -zlog^Q. 

|z|-*» 

In  consequence,  the  contour  lm(4')=0  will  eventually  level  off  with  zero  slope.  It  will 
therefore  pass  to  infinity  in  the  first  quadrant  of  the  complex  plane  and  there  is  no 
difficulty  in  deforming  the  path  of  the  integral  of  Equation  (A6-7)  to  follow  it.  In 
order  to  show  how  an  algorithm  may  be  constructed  along  these  lines,  the  remainder 
of  this  Appendix  is  given  over  to  a  discussion  of  the  following  topics:  (1)  a  procedure 
for  finding  the  saddle  poin-,  (2)  the  behavior  of  the  contour  in  its  vicinity.  (3)  a  proce¬ 
dure  for  locating  points  on  the  contour  for  numerical  integration,  and  (4)  a  stopping 
rule,  or  truncation  bound,  for  the  integration. 

We  have  shown  that  the  integrand  in  Equation  (A6-10)  has  a  unique  minimum  on 
the  real  axis  between  the  origin  and  the  first  pole  at  x  =  K  + 1.  It  follows  that  the  first 
derivative  of  4  has  a  unique  zero  in  this  range,  and  it  may  be  located  by  Newton's 
method  using  the  iteration: 
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Xn  +  1  =  X„ 


Substituting  Equation  (A6-6)  into  (A6-9),  we  obium  the  explicit  formula 

+(x)  =  -  Xo«  -  log  X  ■£  Y,  1<>8(  )  .  (A6-11) 

j=l  m=l  '  ■'  ' 

and  the  required  derivatives  are  then  given  by 

j  =  l  m=l  •' 

and 


'i'  (x) 


1 

“2 


X 


J  M 

E  E 


j*=l  m=l 


_ 1 _ 

(K  +j-r 


(A6-13) 


The  technique  works  well  in  the  present  case,  provided  a  good  initial  value  is  used  for 
X.  One  approach  is  to  approximate  the  derivative  [Equation  (A6-13)]  and  equate  it  to 
zero,  as  follows: 


~^o  ~ 


i  +  JM 
X  b  -  x 


0  . 


In  this  approximation, 

b  s  K  +  (Jh  M)/2 


is  the  "average"  value  of  K  +  j  +  m  -  1.  The  appropriate  solution  of  this  quadratic  is 


b 

JM  +  1 

/[b 

JM  +  ll 

2 

2A<,  \ 

/U 

2Xo  J 

^0 

(A6-14) 
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and  this  value  has  been  successfully  used  as  a  starting  value  for  x  in  the  Newton 
iteration.  When  Xq  is  zero,  or  when  it  is  small  compared  with  b,  the  limiting  value 


JM  +  1 

should  be  used  instead.  If  the  PFA  is  to  be  computed  for  a  series  of  values  of  Xq,  it  is 
a  good  idea  to  save  the  final  value  of  x  obtained  in  each  case,  and  use  it  as  a  starting 
point  for  the  next  value  of  Xq. 

As  a  function  of  x.  'I'(x)  and  its  derivatives  are  real,  and  the  first  derivative  van* 
ishes  at  the  saddle  point  x  =  /x.  Since  4'(2)  is  an  analytic  function  of  z.  its  derivatives  at 
the  saddle  point  are  the  same  as  those  of  'i'(x).  and  the  expansion 

Im 'I'(z)  =  'I' (^l.)  Im  (z-/i)^/2  +  'P  (^i)lm  (z-^i)^/6  +  ... 

is  valid.  FVom  this  expansion,  we  find  the  equation  of  the  contour:  lm'l'(z)  =  0.  in  the 
immediate  vicinity  of  the  point  z  =  /7: 

y } 'I'  (/x) (x  - m)  +  I  'J'  (m)[3(x-m)^  -  y^]  +  ...  I  =  0  . 

The  solution  y  =  0  falls  on  the  real  axis  through  the  saddle  point,  and  the  other  solu* 
tion  is  described  by 


X 


M  + 


y  (/^)  y2 

6'j'  (m) 


+ 


which  approximates  the  equation  of  a  parabola. 

Equation  (A6-13)  shows  that  the  second  derivative  of  4'  is  positive,  but  the  third 
derivative  (evaluated  at  x=^a)  may  have  either  sign.  Fbr  large  values  of  Xq,  which 
correspond  to  small  values  of  the  PFA.  the  saddle  point  moves  toward  the  pole  at 
x  =  K  +  l,  and  the  third  derivative  will  be  positive.  Then,  the  contour  curves  to  the 
right  as  it  leaves  the  saddle  point,  and  (in  the  examples  studied)  it  has  a  simple 
shape,  leveling  off  as  x  increases.  For  sufficiently  small  values  of  Xq.  the  contour 
curves  initially  to  the  left  and  then  swings  around  to  the  right,  leveling  off  again  as 
it  passes  to  infinity  in  the  first  quadrant  of  the  complex  plane. 
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The  second  derivative  of  'fr,  evaluated  at  the  saddle  point,  also  controls  the 
behavior  of  the  real  part  of  on  the  contour  in  the  vicinity  of  z  =  /x.  The  shape  of 
this  variation  will  also  be  parabolic,  and  its  curvature  can  be  used  to  establish  an  ini¬ 
tial  step  size  A  for  the  numerical  evaluation  of  our  integral,  using  a  formula  such  as 

A  =  constant  (/Li)]  ^  ,  (A6-15) 

with  a  suitable  value  for  the  constant  When  the  second  derivative  of  ^  is  small,  the 
value 


A  =  constant  X  (K  +  1) 

may  be  used  instead,  again  with  a  suitable  value  for  the  constant.  In  the  latter  case, 
we  are  attempting  to  gauge  the  scale  of  the  variation  of  the  integrand  by  the  dis¬ 
tance  from  the  origin  to  the  first  pole  When  the  final  algorithm  is  applied,  the  step 
size  can  be  adjusted  until  the  desired  accuracy  is  attained. 

With  the  saddle  point  located  and  a  step  size  chosen,  we  can  begin  to  find  points 
on  the  desired  contour.  The  first  point  is  obviously  the  saddle  point  itself,  and  the 
starting  value  of  a  search  for  the  second  point  is  chosen  at  a  distance  A.  in  the  posi¬ 
tive  Y  directicn.  A  search  for  the  contour  is  carried  out  in  a  direction  parallel  to  the 
real  axis.  In  general,  given  two  successive  points  Zj,j,j  and  Zj^.  on  the  contour,  we  com¬ 
pute  the  angle  0/^  according  to 


tan 


lm(2i,/-Zf^.i) 

Re  (zn-Zn.,) 


(A6-16) 


This  angle  is  the  slope  of  the  line  joining  these  two  points,  and  we  project  ahead  a 
dist^ance  A  along  this  line  to  obtain  the  starting  value,  say  W(^.  of  a  search  for  Zn+i- 

Wq  =  Zn  +  Ae‘®N  .  (A6-17) 

Using  Newton's  method  again,  we  drive  the  imaginary  part  of  4'(z)  to  zero  along  a  line 
at  right  angles  to  the  first  line,  in  other  words  along  the  line 

w  =  Wq  -  iae'®'"  ,  (A6-10) 
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where  a  is  a  real  variable.  The  iteration  begins  with  a  =  0  and  is  terminated  when  the 
change  in  a  is  sufficiently  small. 

lb  carry  out  this  iteration,  we  require  the  derivative  of  the  imaginary  part  of 
♦(z)  along  this  new  line,  and  to  obtain  it  we  use  the  fact  that  'J'  is  analytic.  Thus,  we 
have 


^  Im  'l'(w)  =  Im  ^  'l'(w)  =  Im  [  -ie^®"  (w)]  . 

We  define  the  real  and  imaginary  parts  of  this  derivative  as  follows. 

^(w)  s  X(w)  +  iY(w)  , 
and  the  iteration  can  then  be  written 

Im'l'(wj^) 

®n+l  *  -X(Wj^)cos0N  +  Y{Wj^)sin0fj 

In  this  formula  w^  is  given  by  the  riglit  side  of  Equation  (A6*18).  with  o  replaced  by 
Oj,.  Finally,  if  we  write  -t-  iTj^^,  we  obtain  the  pair  of  iteration  equations: 

+  K+l-«n)sin0N 

-  («n-M  -  «n)  ^05  0^  .  (A6-20) 

When  the  iteration  is  terminated,  the  final  value  of  w  becomes  the  next  point  on  the 
contour;  Zj^+j. 

If  the  contour  is  followed  exactly,  the  integrand  will  remain  real  by  definition.  If 
the  contour  is  followed  only  approximately,  a  valid  numerical  approximation  to  the 
integral  can  still  be  obtained  but  the  imaginary  part  of  the  integrand  must  also  be 
taken  into  account,  as  in  Helstrom's  procedure.  It  is  feasible,  however,  to  continue  the 
iteration  far  enough  to  locate  the  contour  with  such  precision  that  we  can  ignore  the 
imaginary  part  of  the  integrand,  and  this  method  has  been  chosen  for  our  algorithm. 
As  a  check,  the  correction  terms  due  to  the  imaginary  part  of  the  integrand  were 
carried  along  in  some  examples,  and  they  were  found  to  contribute  negligibly  to  the 
result,  being  many  orders  of  magnitude  lower  than  the  contributions  of  the  real  part. 
In  these  examples,  the  iteration  was  stopped  when  the  change  in  the  imaginary  part 
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•4 

of  '{'  fell  below  10  in  magnitude.  We  also  found  that  very  few  iterations  were  needed 
to  locate  the  contour  in  this  way.  A  further  advantage  of  this  approach  lies  in  the 
fact  that  the  real  part  of  >{'  changes  only  slightly  during  the  search,  hence  the  accu¬ 
racy  of  the  resulting  value  is  enhanced. 

It  remains  to  derive  a  truncation  bound,  assuming  that  the  integral  (evaluated 
by  a  simple  rectangular  or  trapezoidal  rule)  is  terminated  at  the  point  z'  on  the  con- 
toar.  Let  R  be  the  remainder  after  truncation.  Instead  of  following  the  steepest 
descent  contour,  we  express  the  remainder  as  an  integral  edong  a  path  parallel  to  the 
real  axis,  beginning  at  the  point  z'; 


R  =  ^  J  G(z)dz  ,  (A6-21) 

Z' 

where  G(z)  is  the  original  integrand; 

G(z)  s  exp['l'(z)]  =  .  (A6-22) 

Along  the  steepest  descent  contour  this  integrand  is  real,  and  only  the  differential  dz 
is  complex.  Since  that  contour  tends  to  level  off  for  large  z.  the  effect  of  the  imagi¬ 
nary  part,  applied  to  dz,  is  to  improve  the  convergence  of  the  integral.  On  the 
remainder  portion,  the  differential  is  real  and  the  integrand  becomes  complex.  We  put 
2  =  z'  +  (  on  the  remainder  contour,  and  write  R  in  the  form 


R  = 


1 

TT 


G(z') 


G(z--fO 

G(z’) 


Note  that  G(z')  is  real  and  that  this  is  an  exact  expression  for  the  remainder. 
Substituting  from  Equation  (A6-22).  we  can  write 


Im 


G(z'"()] 

G(z') 


e'^o^  H(0  . 


where 
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(A6-23) 


The  remainder  can  now  be  bounded  as  follows: 


w 

R<  ^G(2')|  |H(0;d^ 


(A6-24) 


and  we  also  have 


iH(«^ .  fi  n  I 

j  =  l  m=l  I  J  ' 


If  we  define 


^j.rr.  =  K  +  j  +  m-  1  . 


and  also  put 


z'  s  X'  +  iy' 


then  we  can  write 


x'-Xi_  +  iy' 

iH(oi  <  n  n  x--"-"(^iy 

j=l  in=l  * 


(A6-25) 


In  those  factors  for  which 


X'-Xj_m  >  0  . 


we  have 


<  1  . 


230 


This  situation  occurs  for  those  factors  corresponding  to  poles  to  the  left  of  the  stop¬ 
ping  point  for  truncation.  On  the  other  hand,  when 

we  obtain  the  bound 


x'-Xj.m  +  iy' 

< 

x'-Xjm+iy' 

y 

<  1  + 


X  -  X 


In  this  way.  we  compute  the  bound 


1H(0:  <  Ho  . 


(A6-26) 


(A6-27) 


where  Hq  is  a  product  of  factors  like  those  of  Equation  (A6-26).  This  bound  is  now 
independent  of  (  and,  when  it  is  substituted  in  Equation  (A6-24),  the  final  result 


R  < 


f  G(z')^ 
~  An 


(A6-28) 


is  obtained.  The  bound  is  easily  computed  as  the  numerical  integration  progresses, 
and  the  latter  is  terminated  when  the  bound  falls  below  a  preset  value 
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APPENDIX  7 

COMPUTATIONAL  ALGORITHMS 


In  Section  2,  a  Generalized  Likelihood  Ratio  (GLR)  test  was  derived  in  which  detec¬ 
tion  is  based  on  the  comparison  of  a  test  statistic  to  a  fixed  threshold.  The  quantity 
to  be  evaluated  is  reproduced  here: 


L  = 


Hm  4-  zgs-‘Zpi 

Hm  -  zJPZpl 


(A7-1) 


where 


Zp  =  ZT”(TT”r'^ 

S  =  Z[Il  -  t]z“  (A7-2) 

and 

P  =  S'*  -  S*^a(a“s'’(7)'‘ .  (A7-3) 

The  data  array  Z  and  the  known  signal  arrays  o  and  t  were  introduced  in  Section  1. 
Here,  we  present  an  algorithm  for  the  computation  of  the  right  side  of  Equa¬ 
tion  (A7-1),  This  algorithm  utilizes  a  standard  technique  of  signal  processing,  namely 
the  construction  of  a  unitary  matrix  which,  multiplying  a  known  array,  converts  it 
into  “triangular"  form.  More  precisely,  when  the  unitary  matrix  pre-multiplies  the 
(generally  rectangular)  known  array,  the  resulting  array  has  all  zeros  below  the  main 
diagonal.  When  post-multiplying,  the  result  has  zeros  above  the  main  diagonal.  Several 
-^techniques  are  available  for  constructing  these  unitary  matrices.^  They  are  iterative 
in  nature,  building  the  unitary  matrix  as  a  product  of  factors,  each  of  which  is.  for 
example,  a  Householder  reflection  matrix  or  a  Givens  rotation.  We  take  this  construc¬ 
tion  for  granted,  without  further  discussion  here. 

We  begin  with  the  known  array  t  and  assume  that  U.^  unitary  matrix 

with  the  property  that 

=  [  p  0  ]  . 


233 


where  p  is  an  M  x  M  matrix.  Since  t  has  rank  M.  p  will  be  non-singular.  The  procedure 
described  above  will  suffice  for  the  construction  of  but  in  this  particular  case  it  is 
unimportant  that  p  be  triangular  in  form.  Notice  that  the  construction  of  U.^  cannot 
be  charged  to  the  cost  of  computing  the  test  statistic,  since  t  is  known  and  can 
be  developed  once  and  for  all.  We  multiply  the  data  array  by  U.^  on  the  right,  and 
then  partition  the  result,  as  follows: 

ZLV  =  iZi  Zg]  .  (A7-4) 

where  Zj  is  N  x  M  and  Z2  is  N  x  (L  -  M)  in  dimension  FVom  these  definitions  it  follows 
that 


TT^-  =  -  (  p  0 


(A7-5) 


and 


Zp  =  ZLVu”t“(tt”)"’^ 
‘“■(pp”) 


-  i  Zj  Zg 


0 


Hr  1/2 


H  / .  .Hx-i/Z 


=  ZjP  (pp  ) 


(A7-6) 


Since  the  matrix  p^(pp^)*'^  is  unitary,  it  is  easily  shown  that  the  GLR  test  is  the 
same  as 


ily  +  Z^PZil 

Fbom  Equation  (A7-4),  we  obtain 
ZZ“  =  ZjZf  +  ZgZj  . 
and  from  Equation  (A7-6)  we  have 


(A7.7) 
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(A7.8) 


Zp7p  =  ZjZ”  . 

These  facts  give  us  the  result 

s  =  zz”  -  ZpZ”  = 

The  component  arrays  Zj  and  Z2  are  directly  analogous  to  Zp  and  Z^,  and,  in  the  spe¬ 
cial  case  described  by  Equatio.i  (1-3),  the  former  are  identical  to  the  latter. 

Having  found  Zg.  we  now  generate  a  unitary  matrix  Ug  which  converts  it  to  the 

form 

Z-aUg^lLgOj.  (A7-9) 

where  Lg  itself  is  lower  triai'^ular  Then, 

S  =  LgLg  , 

m  analogy  to  the  derivation  of  Equation  (A7-5)  Smce  S  is  non-sir.gular,  the  same  is 
true  of  Lg,  and  the  numerator  of  Equation  (A7-7)  can  therefore  be  written  ir.  the 
form 

Hm  (Lg’Zi)”(L2'^Zi)|  .  (A7-10) 

Using  the  definition  (A7-3),  we  have 

P  =  (LgYdN-^N)^'  ■ 

where 

Pn  ~  ^^2  ^^2 

These  results  give  us  the  expression 
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Hm  +  (L2'‘Zi)”(In-Pn)(L2‘z,)1 


(A7-11) 


for  the  GLR  test  statistic. 

Next,  we  introduce  the  arrays  V  and  fj,  as  solutions  of  the  sets  of  equations 

LgV  =  Zi 

L2M  =  a  .  (A7-12) 


These  equations  are  easily  solved  because  of  the  triangular  form  of  L2,  they  are  just 
like  the  "back  solutions"  which  arise  in  conventional  adaptive  nulling  algorithms.  In 
terms  of  the  new  quantities,  we  have 

Pn  =  (A7-13) 


and 


I  Hm  v“vi 

'  |1„  v«(i„  -  p„)Vi 

Now  we  find  a  unitary  matrix  which  converts  to  the  form 


(A7.14) 


= 


V 

0 


where  u  is  an  upper  triangular  matrix.  Since?  fj..  like  a,  is  NxJ  in  dimension  and  of 
rank  J,  the  new  array  v  will  be  J  x  J  and  non-singular.  A  simple  calculation  now  shows 
that 


Ij  0 
00/ 

hence  we  find 


UmPnL'"  - 
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U;.(In-Pn)u!I  =  I  °  °  ■  (A7-15) 

I  ^  *N-J. 

32 

This  treatment  of  projection  matrices,  such  as  Pjj.  has  been  used  as  a  means  of 
deriving  an  architecture  for  their  implementation  in  hardware.  Note  that  the  right 
side  of  Equation  (A7-15)  is  simply  zero  in  the  special  case  J  =  N. 

In  the  algorithm  itself  we  find  and  apply  it  to  V.  calling  the  result  W; 

U^V  =  W  .  (A7-16) 

The  matrix  /x  is  discarded  when  the  development  of  is  complete.  Obviously. 

v”v  =  w“w  . 


and  also 

v"(In  -  Pn)v  = 

The  array  W  is  then  partitioned: 

W  E  .  (A7-17) 

IWbI 

where  is  JxM  and  Wg  is  (N-J)xM  in  dimension.  Arrays  W,  V,  and  Zj  all  have  the 
dimension  of  Zp 

We  substitute  now,  and  obtain  the  form 


lly  4  W”W| 

■  |i„  +  wJwbI  ' 
for  the  test.  But  we  can  write 


(A7-18) 
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and  then  find  a  unitary  matrix  1),^.  which  has  the  property 


w 

Yn 

0 

where  Yj^  is  upper  triangular.  Similarly,  we  choose  to  make 


U. 


Yd 

[ImI 

0 

where  Y^j  is  also  upper  triangular.  Arrays  Yj,  and  Y^j  are  both  of  dimension  MxM. 
With  these  transformations,  we  obtain 


IyJyj 


(A7-19) 


The  determinants  are  now  easy  to  evaluate  and.  for  simplicity,  we  assume  that  Uj, 
and  Uj  have  been  chosen  so  that  the  diagonal  elements  of  Y^  and  Y^  are  rc?)  {'this  is 

easily  accomplished)  If  the  diagonal  elements  of  Y,,  are  (aj . aj^)  and  those  of  Yj 

are  (bj . bj^),  then 


(A7.20) 


and  the  test  can  actually  be  carried  out  in  the  form 


M 


Note  that  all  operations  except  the  last  involve  linear  operations  on  the  data  and  sig* 
nal  arrays. 

The  same  technique  can  be  applied  to  the  alternative  form  of  the  GLR  lest  sta¬ 
tistic,  expressed  by  Equation  (2-57).  The  components  Zj  and  Z2  are  formed,  as 
described  above,  and  the  matrix  S  is  then  evaluated  using  Equation  (A7-0).  Equa¬ 
tion  (2-57)  is  written  in  the  form 
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i 


(A7-21) 


|(7”(ZZ“)''£7| 

ftnd  the  unitary  matrix  Ug  [defined  by  Equation  (A7-9)]  is  found  as  before.  Another 
unitary  matrix,  say  U^.  is  generated  which  will  convert  Z  itself  to  lower  triangular 
form,  according  to 


Z  Uj  =  (  Lj  0  . 


Then,  we  have 


|(L,-‘a)”(L,''a)l  ’ 


(A7-22) 


and  the  next  step  is  the  introduction  of  new  arrays  and  /xg  as  the  solutions  of  the 
equations 


L;/^i  =  a 
Lg  Mg  -  ^  ■ 

These  arrays  are  of  dimension  Nxj,  and  is  identical  to  m*  defined  in  Equa* 
tion  (A7-12). 

The  test  statistic  takes  the  simple  form 


l/Zg  /Zgl 

I  =  - 

I  H  ■ 

IMi  Ml  I 


(A7-23) 


in  terms  of  these  arrays  Finally,  we  form  two  JxJ  unitary  matrices,  which  will  again 
be  called  and  U^.  and  which  convert  the  arrays  into  upper  triangular  form  by 
premultipl  icat  ion ; 
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^’n  = 


0 


With  these  transformations,  the  test  statistic  assumes  the  same  form  as  Equa> 
tion  (A7-19),  and  the  remainder  of  the  analysis  is  unchanged. 
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